2023-07-24 17:06:23,080 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 17:06:23,335 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4 2023-07-24 17:06:23,336 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-24 17:06:23,336 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-24 17:06:23,372 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 17:06:23,613 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 17:06:23,614 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592, deleteOnExit=true 2023-07-24 17:06:23,614 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 17:06:23,615 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/test.cache.data in system properties and HBase conf 2023-07-24 17:06:23,615 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 17:06:23,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop.log.dir in system properties and HBase conf 2023-07-24 17:06:23,617 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 17:06:23,617 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 17:06:23,617 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 17:06:23,937 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 17:06:23,943 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 17:06:23,944 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 17:06:23,944 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 17:06:23,945 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 17:06:23,945 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 17:06:23,946 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 17:06:23,946 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 17:06:23,947 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 17:06:23,947 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 17:06:23,948 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/nfs.dump.dir in system properties and HBase conf 2023-07-24 17:06:23,948 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir in system properties and HBase conf 2023-07-24 17:06:23,948 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 17:06:23,949 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 17:06:23,949 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 17:06:24,560 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 17:06:24,564 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 17:06:24,842 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 17:06:25,005 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 17:06:25,018 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:25,061 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:25,101 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir/Jetty_localhost_39451_hdfs____.pd4430/webapp 2023-07-24 17:06:25,255 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39451 2023-07-24 17:06:25,304 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 17:06:25,305 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 17:06:25,790 WARN [Listener at localhost/45525] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 17:06:25,885 WARN [Listener at localhost/45525] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 17:06:25,914 WARN [Listener at localhost/45525] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:25,922 INFO [Listener at localhost/45525] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:25,931 INFO [Listener at localhost/45525] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir/Jetty_localhost_33373_datanode____.wuxl7u/webapp 2023-07-24 17:06:26,051 INFO [Listener at localhost/45525] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33373 2023-07-24 17:06:26,592 WARN [Listener at localhost/33343] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 17:06:26,623 WARN [Listener at localhost/33343] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 17:06:26,626 WARN [Listener at localhost/33343] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:26,628 INFO [Listener at localhost/33343] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:26,635 INFO [Listener at localhost/33343] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir/Jetty_localhost_37069_datanode____.k4br0q/webapp 2023-07-24 17:06:26,751 INFO [Listener at localhost/33343] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37069 2023-07-24 17:06:26,771 WARN [Listener at localhost/39445] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 17:06:26,815 WARN [Listener at localhost/39445] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 17:06:26,818 WARN [Listener at localhost/39445] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:26,821 INFO [Listener at localhost/39445] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:26,830 INFO [Listener at localhost/39445] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir/Jetty_localhost_46261_datanode____scu4nm/webapp 2023-07-24 17:06:26,974 INFO [Listener at localhost/39445] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46261 2023-07-24 17:06:27,013 WARN [Listener at localhost/37833] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 17:06:27,331 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9968995ddb62e33a: Processing first storage report for DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0 from datanode a3d3e541-8ce7-4b0c-83d0-3affe9d25e07 2023-07-24 17:06:27,333 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9968995ddb62e33a: from storage DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0 node DatanodeRegistration(127.0.0.1:45415, datanodeUuid=a3d3e541-8ce7-4b0c-83d0-3affe9d25e07, infoPort=45615, infoSecurePort=0, ipcPort=37833, storageInfo=lv=-57;cid=testClusterID;nsid=1882666298;c=1690218384633), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,334 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x52ed68a67cdc43d2: Processing first storage report for DS-ba5b00b3-bf17-4955-8974-6f71d357ae59 from datanode e6ceb162-eb6e-4b23-b1c0-384224e915f9 2023-07-24 17:06:27,334 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x52ed68a67cdc43d2: from storage DS-ba5b00b3-bf17-4955-8974-6f71d357ae59 node DatanodeRegistration(127.0.0.1:36147, datanodeUuid=e6ceb162-eb6e-4b23-b1c0-384224e915f9, infoPort=46407, infoSecurePort=0, ipcPort=39445, storageInfo=lv=-57;cid=testClusterID;nsid=1882666298;c=1690218384633), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,334 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9968995ddb62e33a: Processing first storage report for DS-f6019c5f-8657-4710-8c55-8be61177d766 from datanode a3d3e541-8ce7-4b0c-83d0-3affe9d25e07 2023-07-24 17:06:27,334 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9968995ddb62e33a: from storage DS-f6019c5f-8657-4710-8c55-8be61177d766 node DatanodeRegistration(127.0.0.1:45415, datanodeUuid=a3d3e541-8ce7-4b0c-83d0-3affe9d25e07, infoPort=45615, infoSecurePort=0, ipcPort=37833, storageInfo=lv=-57;cid=testClusterID;nsid=1882666298;c=1690218384633), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,335 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x52ed68a67cdc43d2: Processing first storage report for DS-986be199-6a6e-4317-a2d4-59600577960f from datanode e6ceb162-eb6e-4b23-b1c0-384224e915f9 2023-07-24 17:06:27,335 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x52ed68a67cdc43d2: from storage DS-986be199-6a6e-4317-a2d4-59600577960f node DatanodeRegistration(127.0.0.1:36147, datanodeUuid=e6ceb162-eb6e-4b23-b1c0-384224e915f9, infoPort=46407, infoSecurePort=0, ipcPort=39445, storageInfo=lv=-57;cid=testClusterID;nsid=1882666298;c=1690218384633), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,335 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x44622257ceaaf954: Processing first storage report for DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75 from datanode d5918fc8-f1d3-4eea-a2bd-a23c88cfa0b1 2023-07-24 17:06:27,335 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x44622257ceaaf954: from storage DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75 node DatanodeRegistration(127.0.0.1:34323, datanodeUuid=d5918fc8-f1d3-4eea-a2bd-a23c88cfa0b1, infoPort=46091, infoSecurePort=0, ipcPort=33343, storageInfo=lv=-57;cid=testClusterID;nsid=1882666298;c=1690218384633), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,335 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x44622257ceaaf954: Processing first storage report for DS-a6c7409e-e20c-41b9-958d-18cb7f74175d from datanode d5918fc8-f1d3-4eea-a2bd-a23c88cfa0b1 2023-07-24 17:06:27,336 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x44622257ceaaf954: from storage DS-a6c7409e-e20c-41b9-958d-18cb7f74175d node DatanodeRegistration(127.0.0.1:34323, datanodeUuid=d5918fc8-f1d3-4eea-a2bd-a23c88cfa0b1, infoPort=46091, infoSecurePort=0, ipcPort=33343, storageInfo=lv=-57;cid=testClusterID;nsid=1882666298;c=1690218384633), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-24 17:06:27,507 DEBUG [Listener at localhost/37833] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4 2023-07-24 17:06:27,585 INFO [Listener at localhost/37833] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/zookeeper_0, clientPort=49485, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 17:06:27,606 INFO [Listener at localhost/37833] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49485 2023-07-24 17:06:27,618 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:27,620 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:28,300 INFO [Listener at localhost/37833] util.FSUtils(471): Created version file at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 with version=8 2023-07-24 17:06:28,300 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/hbase-staging 2023-07-24 17:06:28,665 INFO [Listener at localhost/37833] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 17:06:29,213 INFO [Listener at localhost/37833] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 17:06:29,278 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:29,279 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:29,279 INFO [Listener at localhost/37833] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 17:06:29,279 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:29,280 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 17:06:29,473 INFO [Listener at localhost/37833] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 17:06:29,563 DEBUG [Listener at localhost/37833] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 17:06:29,672 INFO [Listener at localhost/37833] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39283 2023-07-24 17:06:29,688 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:29,690 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:29,714 INFO [Listener at localhost/37833] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39283 connecting to ZooKeeper ensemble=127.0.0.1:49485 2023-07-24 17:06:29,770 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:392830x0, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 17:06:29,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39283-0x101984c5b6e0000 connected 2023-07-24 17:06:29,811 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:06:29,812 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:06:29,829 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 17:06:29,842 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39283 2023-07-24 17:06:29,843 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39283 2023-07-24 17:06:29,844 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39283 2023-07-24 17:06:29,846 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39283 2023-07-24 17:06:29,850 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39283 2023-07-24 17:06:29,859 INFO [Listener at localhost/37833] master.HMaster(444): hbase.rootdir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26, hbase.cluster.distributed=false 2023-07-24 17:06:29,930 INFO [Listener at localhost/37833] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 17:06:29,930 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:29,930 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:29,930 INFO [Listener at localhost/37833] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 17:06:29,930 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:29,931 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 17:06:29,936 INFO [Listener at localhost/37833] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 17:06:29,939 INFO [Listener at localhost/37833] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40941 2023-07-24 17:06:29,943 INFO [Listener at localhost/37833] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 17:06:29,951 INFO [Listener at localhost/37833] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 17:06:29,952 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:29,954 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:29,956 INFO [Listener at localhost/37833] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40941 connecting to ZooKeeper ensemble=127.0.0.1:49485 2023-07-24 17:06:29,963 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:409410x0, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 17:06:29,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40941-0x101984c5b6e0001 connected 2023-07-24 17:06:29,964 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:06:29,966 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:06:29,967 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 17:06:29,967 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40941 2023-07-24 17:06:29,970 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40941 2023-07-24 17:06:29,973 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40941 2023-07-24 17:06:29,986 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40941 2023-07-24 17:06:29,987 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40941 2023-07-24 17:06:30,001 INFO [Listener at localhost/37833] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 17:06:30,001 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,001 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,002 INFO [Listener at localhost/37833] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 17:06:30,002 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,003 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 17:06:30,003 INFO [Listener at localhost/37833] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 17:06:30,004 INFO [Listener at localhost/37833] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42771 2023-07-24 17:06:30,005 INFO [Listener at localhost/37833] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 17:06:30,006 INFO [Listener at localhost/37833] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 17:06:30,007 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,010 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,013 INFO [Listener at localhost/37833] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42771 connecting to ZooKeeper ensemble=127.0.0.1:49485 2023-07-24 17:06:30,017 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:427710x0, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 17:06:30,019 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): regionserver:427710x0, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:06:30,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42771-0x101984c5b6e0002 connected 2023-07-24 17:06:30,020 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:06:30,021 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 17:06:30,022 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42771 2023-07-24 17:06:30,022 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42771 2023-07-24 17:06:30,023 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42771 2023-07-24 17:06:30,023 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42771 2023-07-24 17:06:30,026 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42771 2023-07-24 17:06:30,044 INFO [Listener at localhost/37833] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 17:06:30,045 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,045 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,045 INFO [Listener at localhost/37833] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 17:06:30,046 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 17:06:30,046 INFO [Listener at localhost/37833] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 17:06:30,046 INFO [Listener at localhost/37833] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 17:06:30,048 INFO [Listener at localhost/37833] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45037 2023-07-24 17:06:30,048 INFO [Listener at localhost/37833] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 17:06:30,050 INFO [Listener at localhost/37833] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 17:06:30,051 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,052 INFO [Listener at localhost/37833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,053 INFO [Listener at localhost/37833] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45037 connecting to ZooKeeper ensemble=127.0.0.1:49485 2023-07-24 17:06:30,057 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:450370x0, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 17:06:30,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45037-0x101984c5b6e0003 connected 2023-07-24 17:06:30,059 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:06:30,060 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:06:30,061 DEBUG [Listener at localhost/37833] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 17:06:30,062 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45037 2023-07-24 17:06:30,062 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45037 2023-07-24 17:06:30,063 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45037 2023-07-24 17:06:30,064 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45037 2023-07-24 17:06:30,066 DEBUG [Listener at localhost/37833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45037 2023-07-24 17:06:30,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:06:30,086 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 17:06:30,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:06:30,109 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 17:06:30,109 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 17:06:30,109 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 17:06:30,109 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 17:06:30,109 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:30,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 17:06:30,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39283,1690218388485 from backup master directory 2023-07-24 17:06:30,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 17:06:30,118 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:06:30,118 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 17:06:30,119 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 17:06:30,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:06:30,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 17:06:30,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 17:06:30,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/hbase.id with ID: 1d0b9d54-1c15-4723-be4a-985b003639b6 2023-07-24 17:06:30,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 17:06:30,315 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:30,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4c57d4ea to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:30,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50da4723, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:30,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:30,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 17:06:30,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 17:06:30,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 17:06:30,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 17:06:30,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 17:06:30,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:30,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/data/master/store-tmp 2023-07-24 17:06:30,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:30,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 17:06:30,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:06:30,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:06:30,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 17:06:30,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:06:30,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:06:30,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 17:06:30,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/WALs/jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:06:30,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39283%2C1690218388485, suffix=, logDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/WALs/jenkins-hbase4.apache.org,39283,1690218388485, archiveDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/oldWALs, maxLogs=10 2023-07-24 17:06:30,705 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK] 2023-07-24 17:06:30,705 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK] 2023-07-24 17:06:30,705 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK] 2023-07-24 17:06:30,717 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 17:06:30,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/WALs/jenkins-hbase4.apache.org,39283,1690218388485/jenkins-hbase4.apache.org%2C39283%2C1690218388485.1690218390635 2023-07-24 17:06:30,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK], DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK], DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK]] 2023-07-24 17:06:30,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:06:30,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:30,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:30,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:30,912 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:30,923 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 17:06:30,967 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 17:06:30,984 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:30,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:30,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:31,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 17:06:31,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:31,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60096112, jitterRate=-0.10449814796447754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:31,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 17:06:31,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 17:06:31,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 17:06:31,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 17:06:31,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 17:06:31,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 17:06:31,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 57 msec 2023-07-24 17:06:31,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 17:06:31,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 17:06:31,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 17:06:31,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 17:06:31,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 17:06:31,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 17:06:31,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 17:06:31,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 17:06:31,222 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:31,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 17:06:31,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 17:06:31,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 17:06:31,248 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 17:06:31,248 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 17:06:31,248 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 17:06:31,248 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 17:06:31,248 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:31,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39283,1690218388485, sessionid=0x101984c5b6e0000, setting cluster-up flag (Was=false) 2023-07-24 17:06:31,274 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:31,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 17:06:31,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:06:31,294 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:31,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 17:06:31,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:06:31,306 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp 2023-07-24 17:06:31,376 INFO [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(951): ClusterId : 1d0b9d54-1c15-4723-be4a-985b003639b6 2023-07-24 17:06:31,376 INFO [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(951): ClusterId : 1d0b9d54-1c15-4723-be4a-985b003639b6 2023-07-24 17:06:31,379 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(951): ClusterId : 1d0b9d54-1c15-4723-be4a-985b003639b6 2023-07-24 17:06:31,386 DEBUG [RS:2;jenkins-hbase4:45037] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 17:06:31,386 DEBUG [RS:0;jenkins-hbase4:40941] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 17:06:31,386 DEBUG [RS:1;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 17:06:31,397 DEBUG [RS:1;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 17:06:31,397 DEBUG [RS:1;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 17:06:31,403 DEBUG [RS:0;jenkins-hbase4:40941] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 17:06:31,403 DEBUG [RS:0;jenkins-hbase4:40941] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 17:06:31,404 DEBUG [RS:2;jenkins-hbase4:45037] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 17:06:31,404 DEBUG [RS:2;jenkins-hbase4:45037] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 17:06:31,404 DEBUG [RS:1;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 17:06:31,408 DEBUG [RS:1;jenkins-hbase4:42771] zookeeper.ReadOnlyZKClient(139): Connect 0x63d512e1 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:31,410 DEBUG [RS:2;jenkins-hbase4:45037] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 17:06:31,410 DEBUG [RS:0;jenkins-hbase4:40941] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 17:06:31,421 DEBUG [RS:0;jenkins-hbase4:40941] zookeeper.ReadOnlyZKClient(139): Connect 0x235ab950 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:31,421 DEBUG [RS:2;jenkins-hbase4:45037] zookeeper.ReadOnlyZKClient(139): Connect 0x47831cf3 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:31,444 DEBUG [RS:1;jenkins-hbase4:42771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a502724, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:31,445 DEBUG [RS:1;jenkins-hbase4:42771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5912c3f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 17:06:31,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 17:06:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:31,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 17:06:31,503 DEBUG [RS:0;jenkins-hbase4:40941] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6658335f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:31,503 DEBUG [RS:0;jenkins-hbase4:40941] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59d4de66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 17:06:31,507 DEBUG [RS:2;jenkins-hbase4:45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77b778ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:31,507 DEBUG [RS:2;jenkins-hbase4:45037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26140535, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 17:06:31,524 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40941 2023-07-24 17:06:31,524 DEBUG [RS:2;jenkins-hbase4:45037] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45037 2023-07-24 17:06:31,531 INFO [RS:0;jenkins-hbase4:40941] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 17:06:31,531 INFO [RS:0;jenkins-hbase4:40941] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 17:06:31,532 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 17:06:31,540 INFO [RS:2;jenkins-hbase4:45037] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 17:06:31,542 INFO [RS:2;jenkins-hbase4:45037] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 17:06:31,542 DEBUG [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 17:06:31,543 INFO [RS:2;jenkins-hbase4:45037] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:31,543 DEBUG [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 17:06:31,540 INFO [RS:0;jenkins-hbase4:40941] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:31,544 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 17:06:31,547 INFO [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39283,1690218388485 with isa=jenkins-hbase4.apache.org/172.31.14.131:45037, startcode=1690218390043 2023-07-24 17:06:31,547 DEBUG [RS:1;jenkins-hbase4:42771] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42771 2023-07-24 17:06:31,548 INFO [RS:1;jenkins-hbase4:42771] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 17:06:31,548 INFO [RS:1;jenkins-hbase4:42771] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 17:06:31,548 DEBUG [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 17:06:31,548 INFO [RS:1;jenkins-hbase4:42771] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:31,548 DEBUG [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 17:06:31,549 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39283,1690218388485 with isa=jenkins-hbase4.apache.org/172.31.14.131:40941, startcode=1690218389929 2023-07-24 17:06:31,551 INFO [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39283,1690218388485 with isa=jenkins-hbase4.apache.org/172.31.14.131:42771, startcode=1690218390000 2023-07-24 17:06:31,570 DEBUG [RS:2;jenkins-hbase4:45037] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 17:06:31,571 DEBUG [RS:0;jenkins-hbase4:40941] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 17:06:31,570 DEBUG [RS:1;jenkins-hbase4:42771] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 17:06:31,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 17:06:31,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 17:06:31,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 17:06:31,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 17:06:31,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 17:06:31,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 17:06:31,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:31,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 17:06:31,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:31,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690218421635 2023-07-24 17:06:31,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 17:06:31,646 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 17:06:31,647 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 17:06:31,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 17:06:31,657 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55341, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 17:06:31,657 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44323, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 17:06:31,657 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37451, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 17:06:31,661 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:31,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 17:06:31,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 17:06:31,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 17:06:31,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 17:06:31,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,668 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39283] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 17:06:31,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 17:06:31,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 17:06:31,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 17:06:31,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 17:06:31,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 17:06:31,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690218391686,5,FailOnTimeoutGroup] 2023-07-24 17:06:31,687 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39283] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 17:06:31,687 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39283] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 17:06:31,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690218391687,5,FailOnTimeoutGroup] 2023-07-24 17:06:31,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 17:06:31,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,739 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 17:06:31,743 DEBUG [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 17:06:31,743 WARN [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 17:06:31,739 DEBUG [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 17:06:31,743 WARN [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 17:06:31,743 WARN [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 17:06:31,783 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:31,784 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:31,785 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:06:31,829 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:31,832 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 17:06:31,837 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/info 2023-07-24 17:06:31,838 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 17:06:31,840 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:31,841 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 17:06:31,844 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/rep_barrier 2023-07-24 17:06:31,844 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39283,1690218388485 with isa=jenkins-hbase4.apache.org/172.31.14.131:40941, startcode=1690218389929 2023-07-24 17:06:31,844 INFO [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39283,1690218388485 with isa=jenkins-hbase4.apache.org/172.31.14.131:42771, startcode=1690218390000 2023-07-24 17:06:31,844 INFO [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39283,1690218388485 with isa=jenkins-hbase4.apache.org/172.31.14.131:45037, startcode=1690218390043 2023-07-24 17:06:31,845 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 17:06:31,847 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:31,847 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 17:06:31,850 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/table 2023-07-24 17:06:31,850 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 17:06:31,851 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:31,852 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39283] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:31,854 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740 2023-07-24 17:06:31,854 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740 2023-07-24 17:06:31,859 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 17:06:31,859 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39283] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:31,861 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39283] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:31,863 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 17:06:31,864 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:06:31,864 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45525 2023-07-24 17:06:31,864 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 17:06:31,864 DEBUG [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:06:31,869 DEBUG [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45525 2023-07-24 17:06:31,870 DEBUG [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 17:06:31,871 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:31,872 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60064175, jitterRate=-0.10497404634952545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 17:06:31,872 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 17:06:31,872 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 17:06:31,872 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 17:06:31,872 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 17:06:31,872 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 17:06:31,872 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 17:06:31,873 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 17:06:31,873 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 17:06:31,878 DEBUG [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:06:31,878 DEBUG [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45525 2023-07-24 17:06:31,878 DEBUG [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 17:06:31,880 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 17:06:31,880 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 17:06:31,884 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:06:31,900 DEBUG [RS:1;jenkins-hbase4:42771] zookeeper.ZKUtil(162): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:31,900 DEBUG [RS:0;jenkins-hbase4:40941] zookeeper.ZKUtil(162): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:31,900 WARN [RS:1;jenkins-hbase4:42771] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 17:06:31,901 DEBUG [RS:2;jenkins-hbase4:45037] zookeeper.ZKUtil(162): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:31,901 INFO [RS:1;jenkins-hbase4:42771] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:31,902 DEBUG [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:31,901 WARN [RS:0;jenkins-hbase4:40941] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 17:06:31,901 WARN [RS:2;jenkins-hbase4:45037] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 17:06:31,907 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40941,1690218389929] 2023-07-24 17:06:31,907 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42771,1690218390000] 2023-07-24 17:06:31,907 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45037,1690218390043] 2023-07-24 17:06:31,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 17:06:31,903 INFO [RS:0;jenkins-hbase4:40941] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:31,912 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:31,903 INFO [RS:2;jenkins-hbase4:45037] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:31,913 DEBUG [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:31,925 DEBUG [RS:0;jenkins-hbase4:40941] zookeeper.ZKUtil(162): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:31,926 DEBUG [RS:2;jenkins-hbase4:45037] zookeeper.ZKUtil(162): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:31,926 DEBUG [RS:2;jenkins-hbase4:45037] zookeeper.ZKUtil(162): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:31,927 DEBUG [RS:1;jenkins-hbase4:42771] zookeeper.ZKUtil(162): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:31,927 DEBUG [RS:2;jenkins-hbase4:45037] zookeeper.ZKUtil(162): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:31,928 DEBUG [RS:1;jenkins-hbase4:42771] zookeeper.ZKUtil(162): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:31,928 DEBUG [RS:0;jenkins-hbase4:40941] zookeeper.ZKUtil(162): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:31,928 DEBUG [RS:1;jenkins-hbase4:42771] zookeeper.ZKUtil(162): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:31,929 DEBUG [RS:0;jenkins-hbase4:40941] zookeeper.ZKUtil(162): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:31,930 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 17:06:31,933 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 17:06:31,943 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 17:06:31,943 DEBUG [RS:1;jenkins-hbase4:42771] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 17:06:31,943 DEBUG [RS:2;jenkins-hbase4:45037] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 17:06:31,955 INFO [RS:1;jenkins-hbase4:42771] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 17:06:31,955 INFO [RS:0;jenkins-hbase4:40941] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 17:06:31,955 INFO [RS:2;jenkins-hbase4:45037] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 17:06:31,980 INFO [RS:0;jenkins-hbase4:40941] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 17:06:31,980 INFO [RS:1;jenkins-hbase4:42771] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 17:06:31,989 INFO [RS:1;jenkins-hbase4:42771] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 17:06:31,989 INFO [RS:0;jenkins-hbase4:40941] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 17:06:31,990 INFO [RS:1;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,990 INFO [RS:2;jenkins-hbase4:45037] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 17:06:31,990 INFO [RS:0;jenkins-hbase4:40941] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,991 INFO [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 17:06:31,991 INFO [RS:2;jenkins-hbase4:45037] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 17:06:31,991 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 17:06:31,992 INFO [RS:2;jenkins-hbase4:45037] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:31,997 INFO [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 17:06:32,005 INFO [RS:0;jenkins-hbase4:40941] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,005 INFO [RS:2;jenkins-hbase4:45037] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,005 INFO [RS:1;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,006 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,006 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,006 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,006 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,006 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,006 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,006 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,006 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 17:06:32,007 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 17:06:32,007 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,007 DEBUG [RS:2;jenkins-hbase4:45037] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,006 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,008 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,008 DEBUG [RS:0;jenkins-hbase4:40941] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,008 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,008 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,008 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 17:06:32,008 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,008 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,008 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,009 DEBUG [RS:1;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 17:06:32,021 INFO [RS:1;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,022 INFO [RS:1;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,022 INFO [RS:1;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,029 INFO [RS:2;jenkins-hbase4:45037] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,029 INFO [RS:2;jenkins-hbase4:45037] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,029 INFO [RS:2;jenkins-hbase4:45037] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,030 INFO [RS:0;jenkins-hbase4:40941] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,030 INFO [RS:0;jenkins-hbase4:40941] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,030 INFO [RS:0;jenkins-hbase4:40941] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,049 INFO [RS:1;jenkins-hbase4:42771] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 17:06:32,049 INFO [RS:2;jenkins-hbase4:45037] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 17:06:32,051 INFO [RS:0;jenkins-hbase4:40941] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 17:06:32,055 INFO [RS:2;jenkins-hbase4:45037] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45037,1690218390043-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,055 INFO [RS:1;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42771,1690218390000-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,055 INFO [RS:0;jenkins-hbase4:40941] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40941,1690218389929-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,097 DEBUG [jenkins-hbase4:39283] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 17:06:32,100 INFO [RS:2;jenkins-hbase4:45037] regionserver.Replication(203): jenkins-hbase4.apache.org,45037,1690218390043 started 2023-07-24 17:06:32,101 INFO [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45037,1690218390043, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45037, sessionid=0x101984c5b6e0003 2023-07-24 17:06:32,101 DEBUG [RS:2;jenkins-hbase4:45037] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 17:06:32,101 DEBUG [RS:2;jenkins-hbase4:45037] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:32,101 DEBUG [RS:2;jenkins-hbase4:45037] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45037,1690218390043' 2023-07-24 17:06:32,101 DEBUG [RS:2;jenkins-hbase4:45037] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 17:06:32,102 DEBUG [jenkins-hbase4:39283] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:32,102 DEBUG [RS:2;jenkins-hbase4:45037] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 17:06:32,107 INFO [RS:0;jenkins-hbase4:40941] regionserver.Replication(203): jenkins-hbase4.apache.org,40941,1690218389929 started 2023-07-24 17:06:32,107 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40941,1690218389929, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40941, sessionid=0x101984c5b6e0001 2023-07-24 17:06:32,107 DEBUG [RS:2;jenkins-hbase4:45037] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 17:06:32,107 DEBUG [RS:2;jenkins-hbase4:45037] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 17:06:32,107 DEBUG [RS:2;jenkins-hbase4:45037] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:32,107 DEBUG [RS:2;jenkins-hbase4:45037] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45037,1690218390043' 2023-07-24 17:06:32,107 DEBUG [RS:2;jenkins-hbase4:45037] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:32,108 INFO [RS:1;jenkins-hbase4:42771] regionserver.Replication(203): jenkins-hbase4.apache.org,42771,1690218390000 started 2023-07-24 17:06:32,108 DEBUG [RS:0;jenkins-hbase4:40941] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 17:06:32,108 INFO [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42771,1690218390000, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42771, sessionid=0x101984c5b6e0002 2023-07-24 17:06:32,108 DEBUG [RS:0;jenkins-hbase4:40941] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:32,109 DEBUG [RS:1;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 17:06:32,109 DEBUG [RS:1;jenkins-hbase4:42771] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:32,109 DEBUG [RS:2;jenkins-hbase4:45037] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:32,111 DEBUG [RS:2;jenkins-hbase4:45037] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 17:06:32,111 INFO [RS:2;jenkins-hbase4:45037] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 17:06:32,111 INFO [RS:2;jenkins-hbase4:45037] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 17:06:32,109 DEBUG [RS:0;jenkins-hbase4:40941] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40941,1690218389929' 2023-07-24 17:06:32,112 DEBUG [RS:0;jenkins-hbase4:40941] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 17:06:32,112 DEBUG [RS:0;jenkins-hbase4:40941] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 17:06:32,109 DEBUG [RS:1;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42771,1690218390000' 2023-07-24 17:06:32,112 DEBUG [RS:1;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 17:06:32,113 DEBUG [RS:0;jenkins-hbase4:40941] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 17:06:32,113 DEBUG [RS:0;jenkins-hbase4:40941] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 17:06:32,113 DEBUG [jenkins-hbase4:39283] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:32,113 DEBUG [RS:0;jenkins-hbase4:40941] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:32,115 DEBUG [RS:1;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 17:06:32,115 DEBUG [jenkins-hbase4:39283] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:32,115 DEBUG [jenkins-hbase4:39283] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:32,115 DEBUG [jenkins-hbase4:39283] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:32,115 DEBUG [RS:0;jenkins-hbase4:40941] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40941,1690218389929' 2023-07-24 17:06:32,116 DEBUG [RS:0;jenkins-hbase4:40941] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:32,117 DEBUG [RS:1;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 17:06:32,117 DEBUG [RS:1;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 17:06:32,117 DEBUG [RS:1;jenkins-hbase4:42771] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:32,117 DEBUG [RS:0;jenkins-hbase4:40941] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:32,117 DEBUG [RS:1;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42771,1690218390000' 2023-07-24 17:06:32,118 DEBUG [RS:1;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:32,118 DEBUG [RS:0;jenkins-hbase4:40941] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 17:06:32,118 DEBUG [RS:1;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:32,119 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40941,1690218389929, state=OPENING 2023-07-24 17:06:32,118 INFO [RS:0;jenkins-hbase4:40941] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 17:06:32,120 INFO [RS:0;jenkins-hbase4:40941] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 17:06:32,122 DEBUG [RS:1;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 17:06:32,122 INFO [RS:1;jenkins-hbase4:42771] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 17:06:32,122 INFO [RS:1;jenkins-hbase4:42771] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 17:06:32,128 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 17:06:32,130 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:32,131 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 17:06:32,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:06:32,226 INFO [RS:1;jenkins-hbase4:42771] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42771%2C1690218390000, suffix=, logDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,42771,1690218390000, archiveDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/oldWALs, maxLogs=32 2023-07-24 17:06:32,236 INFO [RS:0;jenkins-hbase4:40941] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40941%2C1690218389929, suffix=, logDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,40941,1690218389929, archiveDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/oldWALs, maxLogs=32 2023-07-24 17:06:32,237 INFO [RS:2;jenkins-hbase4:45037] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45037%2C1690218390043, suffix=, logDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,45037,1690218390043, archiveDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/oldWALs, maxLogs=32 2023-07-24 17:06:32,304 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK] 2023-07-24 17:06:32,304 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK] 2023-07-24 17:06:32,305 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK] 2023-07-24 17:06:32,312 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK] 2023-07-24 17:06:32,312 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK] 2023-07-24 17:06:32,312 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK] 2023-07-24 17:06:32,314 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK] 2023-07-24 17:06:32,316 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK] 2023-07-24 17:06:32,316 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK] 2023-07-24 17:06:32,325 INFO [RS:2;jenkins-hbase4:45037] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,45037,1690218390043/jenkins-hbase4.apache.org%2C45037%2C1690218390043.1690218392239 2023-07-24 17:06:32,329 DEBUG [RS:2;jenkins-hbase4:45037] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK], DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK], DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK]] 2023-07-24 17:06:32,330 INFO [RS:0;jenkins-hbase4:40941] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,40941,1690218389929/jenkins-hbase4.apache.org%2C40941%2C1690218389929.1690218392239 2023-07-24 17:06:32,330 INFO [RS:1;jenkins-hbase4:42771] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,42771,1690218390000/jenkins-hbase4.apache.org%2C42771%2C1690218390000.1690218392229 2023-07-24 17:06:32,330 DEBUG [RS:0;jenkins-hbase4:40941] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK], DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK], DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK]] 2023-07-24 17:06:32,334 DEBUG [RS:1;jenkins-hbase4:42771] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK], DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK], DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK]] 2023-07-24 17:06:32,357 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:32,362 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:06:32,365 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:06:32,379 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 17:06:32,379 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 17:06:32,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40941%2C1690218389929.meta, suffix=.meta, logDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,40941,1690218389929, archiveDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/oldWALs, maxLogs=32 2023-07-24 17:06:32,408 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK] 2023-07-24 17:06:32,427 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK] 2023-07-24 17:06:32,427 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK] 2023-07-24 17:06:32,456 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/WALs/jenkins-hbase4.apache.org,40941,1690218389929/jenkins-hbase4.apache.org%2C40941%2C1690218389929.meta.1690218392384.meta 2023-07-24 17:06:32,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34323,DS-0a68e69d-3ffb-41ce-8350-3a46aa381e75,DISK], DatanodeInfoWithStorage[127.0.0.1:36147,DS-ba5b00b3-bf17-4955-8974-6f71d357ae59,DISK], DatanodeInfoWithStorage[127.0.0.1:45415,DS-cf6f6269-e4c6-4826-8799-9d9adb2172d0,DISK]] 2023-07-24 17:06:32,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:06:32,462 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 17:06:32,464 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:32,466 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 17:06:32,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 17:06:32,470 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 17:06:32,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 17:06:32,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:32,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 17:06:32,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 17:06:32,497 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 17:06:32,500 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/info 2023-07-24 17:06:32,500 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/info 2023-07-24 17:06:32,501 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 17:06:32,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:32,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 17:06:32,504 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/rep_barrier 2023-07-24 17:06:32,504 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/rep_barrier 2023-07-24 17:06:32,505 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 17:06:32,507 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:32,507 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 17:06:32,509 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/table 2023-07-24 17:06:32,509 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/table 2023-07-24 17:06:32,509 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 17:06:32,510 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:32,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740 2023-07-24 17:06:32,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740 2023-07-24 17:06:32,520 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 17:06:32,523 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 17:06:32,525 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71704032, jitterRate=0.06847333908081055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 17:06:32,530 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 17:06:32,545 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690218392343 2023-07-24 17:06:32,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 17:06:32,573 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 17:06:32,574 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40941,1690218389929, state=OPEN 2023-07-24 17:06:32,578 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 17:06:32,579 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 17:06:32,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 17:06:32,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40941,1690218389929 in 439 msec 2023-07-24 17:06:32,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 17:06:32,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 677 msec 2023-07-24 17:06:32,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1330 sec 2023-07-24 17:06:32,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690218392600, completionTime=-1 2023-07-24 17:06:32,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 17:06:32,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 17:06:32,689 DEBUG [hconnection-0x502bdebf-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:32,699 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:32,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 17:06:32,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690218452730 2023-07-24 17:06:32,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690218512730 2023-07-24 17:06:32,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 128 msec 2023-07-24 17:06:32,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39283,1690218388485-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39283,1690218388485-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39283,1690218388485-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39283, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 17:06:32,783 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 17:06:32,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 17:06:32,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:32,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 17:06:32,812 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:06:32,816 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:06:32,855 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:06:32,857 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98 empty. 2023-07-24 17:06:32,858 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:06:32,858 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 17:06:32,919 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:32,927 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => cb4a43adcf555a87e4f3a1f473fa5c98, NAME => 'hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:06:32,948 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:32,948 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing cb4a43adcf555a87e4f3a1f473fa5c98, disabling compactions & flushes 2023-07-24 17:06:32,948 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:06:32,948 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:06:32,948 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. after waiting 0 ms 2023-07-24 17:06:32,948 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:06:32,948 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:06:32,948 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for cb4a43adcf555a87e4f3a1f473fa5c98: 2023-07-24 17:06:32,958 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:06:32,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690218392961"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218392961"}]},"ts":"1690218392961"} 2023-07-24 17:06:33,006 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 17:06:33,008 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:06:33,016 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218393009"}]},"ts":"1690218393009"} 2023-07-24 17:06:33,023 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 17:06:33,028 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:33,029 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:33,029 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:33,029 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:33,029 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:33,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cb4a43adcf555a87e4f3a1f473fa5c98, ASSIGN}] 2023-07-24 17:06:33,037 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cb4a43adcf555a87e4f3a1f473fa5c98, ASSIGN 2023-07-24 17:06:33,039 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cb4a43adcf555a87e4f3a1f473fa5c98, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40941,1690218389929; forceNewPlan=false, retain=false 2023-07-24 17:06:33,192 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 17:06:33,194 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cb4a43adcf555a87e4f3a1f473fa5c98, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:33,194 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690218393193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218393193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218393193"}]},"ts":"1690218393193"} 2023-07-24 17:06:33,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cb4a43adcf555a87e4f3a1f473fa5c98, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:06:33,368 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:06:33,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb4a43adcf555a87e4f3a1f473fa5c98, NAME => 'hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98.', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:06:33,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. service=AccessControlService 2023-07-24 17:06:33,370 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:33,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:06:33,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:33,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:06:33,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:06:33,373 INFO [StoreOpener-cb4a43adcf555a87e4f3a1f473fa5c98-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:06:33,376 DEBUG [StoreOpener-cb4a43adcf555a87e4f3a1f473fa5c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98/info 2023-07-24 17:06:33,376 DEBUG [StoreOpener-cb4a43adcf555a87e4f3a1f473fa5c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98/info 2023-07-24 17:06:33,377 INFO [StoreOpener-cb4a43adcf555a87e4f3a1f473fa5c98-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb4a43adcf555a87e4f3a1f473fa5c98 columnFamilyName info 2023-07-24 17:06:33,377 INFO [StoreOpener-cb4a43adcf555a87e4f3a1f473fa5c98-1] regionserver.HStore(310): Store=cb4a43adcf555a87e4f3a1f473fa5c98/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:33,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:06:33,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:06:33,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:06:33,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:33,393 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb4a43adcf555a87e4f3a1f473fa5c98; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69827256, jitterRate=0.04050719738006592}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:33,393 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb4a43adcf555a87e4f3a1f473fa5c98: 2023-07-24 17:06:33,396 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98., pid=6, masterSystemTime=1690218393359 2023-07-24 17:06:33,401 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:06:33,402 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:06:33,404 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cb4a43adcf555a87e4f3a1f473fa5c98, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:33,404 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690218393403"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218393403"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218393403"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218393403"}]},"ts":"1690218393403"} 2023-07-24 17:06:33,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 17:06:33,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cb4a43adcf555a87e4f3a1f473fa5c98, server=jenkins-hbase4.apache.org,40941,1690218389929 in 203 msec 2023-07-24 17:06:33,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 17:06:33,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cb4a43adcf555a87e4f3a1f473fa5c98, ASSIGN in 380 msec 2023-07-24 17:06:33,421 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:06:33,421 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218393421"}]},"ts":"1690218393421"} 2023-07-24 17:06:33,426 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 17:06:33,431 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:06:33,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 634 msec 2023-07-24 17:06:33,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 17:06:33,515 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 17:06:33,515 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:33,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 17:06:33,572 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 17:06:33,585 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 17:06:33,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 46 msec 2023-07-24 17:06:33,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 17:06:33,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 17:06:33,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 25 msec 2023-07-24 17:06:33,653 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 17:06:33,659 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 17:06:33,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.540sec 2023-07-24 17:06:33,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 17:06:33,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 17:06:33,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 17:06:33,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39283,1690218388485-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 17:06:33,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39283,1690218388485-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 17:06:33,682 DEBUG [Listener at localhost/37833] zookeeper.ReadOnlyZKClient(139): Connect 0x207f6c1a to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:33,688 DEBUG [Listener at localhost/37833] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35faf608, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:33,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 17:06:33,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 17:06:33,701 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:06:33,704 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:06:33,707 DEBUG [hconnection-0x4f1da2dd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:33,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 17:06:33,710 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:06:33,711 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49 empty. 2023-07-24 17:06:33,714 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:06:33,714 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 17:06:33,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 17:06:33,735 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:33,739 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:06:33,739 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 17:06:33,740 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/test.cache.data in system properties and HBase conf 2023-07-24 17:06:33,740 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 17:06:33,740 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop.log.dir in system properties and HBase conf 2023-07-24 17:06:33,740 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 17:06:33,740 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 17:06:33,740 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 17:06:33,740 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 17:06:33,741 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 17:06:33,741 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 17:06:33,741 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 17:06:33,741 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 17:06:33,741 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 17:06:33,741 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 17:06:33,741 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 17:06:33,741 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 17:06:33,742 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/nfs.dump.dir in system properties and HBase conf 2023-07-24 17:06:33,742 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir in system properties and HBase conf 2023-07-24 17:06:33,742 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 17:06:33,742 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 17:06:33,742 INFO [Listener at localhost/37833] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 17:06:33,788 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:33,790 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7e2cce82bee9e461ff9ee44e54bcef49, NAME => 'hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:06:33,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 17:06:33,858 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:33,858 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 7e2cce82bee9e461ff9ee44e54bcef49, disabling compactions & flushes 2023-07-24 17:06:33,859 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:06:33,859 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:06:33,859 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. after waiting 0 ms 2023-07-24 17:06:33,859 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:06:33,859 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:06:33,859 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 7e2cce82bee9e461ff9ee44e54bcef49: 2023-07-24 17:06:33,866 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:06:33,868 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690218393868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218393868"}]},"ts":"1690218393868"} 2023-07-24 17:06:33,872 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 17:06:33,875 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:06:33,875 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218393875"}]},"ts":"1690218393875"} 2023-07-24 17:06:33,884 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 17:06:33,894 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:33,895 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:33,895 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:33,895 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:33,895 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:33,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7e2cce82bee9e461ff9ee44e54bcef49, ASSIGN}] 2023-07-24 17:06:33,903 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7e2cce82bee9e461ff9ee44e54bcef49, ASSIGN 2023-07-24 17:06:33,906 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=7e2cce82bee9e461ff9ee44e54bcef49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40941,1690218389929; forceNewPlan=false, retain=false 2023-07-24 17:06:34,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 17:06:34,056 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 17:06:34,058 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7e2cce82bee9e461ff9ee44e54bcef49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:34,059 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690218394058"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218394058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218394058"}]},"ts":"1690218394058"} 2023-07-24 17:06:34,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7e2cce82bee9e461ff9ee44e54bcef49, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:06:34,224 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:06:34,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7e2cce82bee9e461ff9ee44e54bcef49, NAME => 'hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49.', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:06:34,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. service=AccessControlService 2023-07-24 17:06:34,225 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:34,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:06:34,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:34,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:06:34,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:06:34,243 INFO [StoreOpener-7e2cce82bee9e461ff9ee44e54bcef49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:06:34,252 DEBUG [StoreOpener-7e2cce82bee9e461ff9ee44e54bcef49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49/l 2023-07-24 17:06:34,252 DEBUG [StoreOpener-7e2cce82bee9e461ff9ee44e54bcef49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49/l 2023-07-24 17:06:34,253 INFO [StoreOpener-7e2cce82bee9e461ff9ee44e54bcef49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e2cce82bee9e461ff9ee44e54bcef49 columnFamilyName l 2023-07-24 17:06:34,255 INFO [StoreOpener-7e2cce82bee9e461ff9ee44e54bcef49-1] regionserver.HStore(310): Store=7e2cce82bee9e461ff9ee44e54bcef49/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:34,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:06:34,261 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:06:34,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:06:34,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:34,276 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7e2cce82bee9e461ff9ee44e54bcef49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73944793, jitterRate=0.10186327993869781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:34,276 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7e2cce82bee9e461ff9ee44e54bcef49: 2023-07-24 17:06:34,281 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49., pid=11, masterSystemTime=1690218394218 2023-07-24 17:06:34,288 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7e2cce82bee9e461ff9ee44e54bcef49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:34,288 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690218394287"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218394287"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218394287"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218394287"}]},"ts":"1690218394287"} 2023-07-24 17:06:34,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:06:34,290 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:06:34,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 17:06:34,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7e2cce82bee9e461ff9ee44e54bcef49, server=jenkins-hbase4.apache.org,40941,1690218389929 in 229 msec 2023-07-24 17:06:34,310 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:06:34,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218394311"}]},"ts":"1690218394311"} 2023-07-24 17:06:34,314 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 17:06:34,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 17:06:34,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=7e2cce82bee9e461ff9ee44e54bcef49, ASSIGN in 402 msec 2023-07-24 17:06:34,321 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:06:34,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 624 msec 2023-07-24 17:06:34,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 17:06:34,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 17:06:34,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 17:06:35,165 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:35,462 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:35,468 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39007_jobhistory____mgmvei/webapp 2023-07-24 17:06:35,639 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 17:06:35,640 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 17:06:35,640 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 17:06:35,643 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 17:06:35,711 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:35,988 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:36,281 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 17:06:36,368 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39007 2023-07-24 17:06:36,664 WARN [Listener at jenkins-hbase4.apache.org/32783] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:37,041 WARN [Listener at jenkins-hbase4.apache.org/32783] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 17:06:37,042 INFO [Listener at jenkins-hbase4.apache.org/32783] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:37,052 INFO [Listener at jenkins-hbase4.apache.org/32783] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39739_cluster____3qratp/webapp 2023-07-24 17:06:37,146 INFO [Listener at jenkins-hbase4.apache.org/32783] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 17:06:37,146 INFO [Listener at jenkins-hbase4.apache.org/32783] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 17:06:37,146 INFO [Listener at jenkins-hbase4.apache.org/32783] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 17:06:37,147 INFO [Listener at jenkins-hbase4.apache.org/32783] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 17:06:37,158 INFO [Listener at jenkins-hbase4.apache.org/32783] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:37,417 INFO [Listener at jenkins-hbase4.apache.org/32783] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:37,700 INFO [Listener at jenkins-hbase4.apache.org/32783] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:37,723 INFO [Listener at jenkins-hbase4.apache.org/32783] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39739 2023-07-24 17:06:38,131 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:06:38,256 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 17:06:38,258 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 17:06:38,258 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 17:06:38,618 WARN [Listener at jenkins-hbase4.apache.org/33435] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:38,662 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:38,663 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 17:06:38,663 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:38,663 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 17:06:38,663 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 17:06:38,664 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 17:06:38,664 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:38,664 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 17:06:38,664 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 17:06:38,664 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 17:06:38,664 WARN [Listener at jenkins-hbase4.apache.org/33435] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 17:06:38,665 INFO [Listener at jenkins-hbase4.apache.org/33435] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:38,674 INFO [Listener at jenkins-hbase4.apache.org/33435] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45831_node____.6rwhu5/webapp 2023-07-24 17:06:38,751 INFO [Listener at jenkins-hbase4.apache.org/33435] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 17:06:38,751 INFO [Listener at jenkins-hbase4.apache.org/33435] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 17:06:38,751 INFO [Listener at jenkins-hbase4.apache.org/33435] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 17:06:38,752 INFO [Listener at jenkins-hbase4.apache.org/33435] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 17:06:38,762 INFO [Listener at jenkins-hbase4.apache.org/33435] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:38,799 INFO [Listener at jenkins-hbase4.apache.org/33435] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:38,901 INFO [Listener at jenkins-hbase4.apache.org/33435] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:38,923 INFO [Listener at jenkins-hbase4.apache.org/33435] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45831 2023-07-24 17:06:39,165 WARN [Listener at jenkins-hbase4.apache.org/33193] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 17:06:39,173 WARN [Listener at jenkins-hbase4.apache.org/33193] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 17:06:39,174 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 17:06:39,183 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40243_node____qsner7/webapp 2023-07-24 17:06:39,247 INFO [Listener at jenkins-hbase4.apache.org/33193] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 17:06:39,247 INFO [Listener at jenkins-hbase4.apache.org/33193] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 17:06:39,247 INFO [Listener at jenkins-hbase4.apache.org/33193] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 17:06:39,247 INFO [Listener at jenkins-hbase4.apache.org/33193] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 17:06:39,257 INFO [Listener at jenkins-hbase4.apache.org/33193] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:39,316 INFO [Listener at jenkins-hbase4.apache.org/33193] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:39,411 INFO [Listener at jenkins-hbase4.apache.org/33193] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 17:06:39,422 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40243 2023-07-24 17:06:39,456 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 17:06:39,458 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:39,542 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=174, ProcessCount=174, AvailableMemoryMB=7753 2023-07-24 17:06:39,542 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-24 17:06:39,560 DEBUG [Listener at jenkins-hbase4.apache.org/33193] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 17:06:39,569 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 17:06:39,577 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 17:06:39,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:39,584 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:06:39,585 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 17:06:39,587 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:06:39,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:39,598 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:39,598 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:39,601 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15 empty. 2023-07-24 17:06:39,603 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5 empty. 2023-07-24 17:06:39,605 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:39,605 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:39,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 17:06:39,644 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:39,647 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8fe240f49e59394784a8210436e8cb15, NAME => 'testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:06:39,647 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 79304ecd9bbcd3cab308fd287d20d9a5, NAME => 'testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:06:39,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:39,713 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:39,714 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 8fe240f49e59394784a8210436e8cb15, disabling compactions & flushes 2023-07-24 17:06:39,714 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:39,714 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:39,714 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. after waiting 0 ms 2023-07-24 17:06:39,714 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:39,714 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:39,714 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 8fe240f49e59394784a8210436e8cb15: 2023-07-24 17:06:39,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:39,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 79304ecd9bbcd3cab308fd287d20d9a5, disabling compactions & flushes 2023-07-24 17:06:39,716 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:39,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:39,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. after waiting 0 ms 2023-07-24 17:06:39,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:39,716 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:39,716 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 79304ecd9bbcd3cab308fd287d20d9a5: 2023-07-24 17:06:39,720 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:06:39,722 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218399721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218399721"}]},"ts":"1690218399721"} 2023-07-24 17:06:39,722 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218399721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218399721"}]},"ts":"1690218399721"} 2023-07-24 17:06:39,773 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:06:39,775 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:06:39,775 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218399775"}]},"ts":"1690218399775"} 2023-07-24 17:06:39,777 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 17:06:39,783 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:39,784 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:39,785 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:39,785 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:39,785 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:39,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79304ecd9bbcd3cab308fd287d20d9a5, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8fe240f49e59394784a8210436e8cb15, ASSIGN}] 2023-07-24 17:06:39,789 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8fe240f49e59394784a8210436e8cb15, ASSIGN 2023-07-24 17:06:39,789 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79304ecd9bbcd3cab308fd287d20d9a5, ASSIGN 2023-07-24 17:06:39,790 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79304ecd9bbcd3cab308fd287d20d9a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40941,1690218389929; forceNewPlan=false, retain=false 2023-07-24 17:06:39,790 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8fe240f49e59394784a8210436e8cb15, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45037,1690218390043; forceNewPlan=false, retain=false 2023-07-24 17:06:39,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:39,940 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:06:39,943 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8fe240f49e59394784a8210436e8cb15, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:39,943 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=79304ecd9bbcd3cab308fd287d20d9a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:39,943 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218399943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218399943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218399943"}]},"ts":"1690218399943"} 2023-07-24 17:06:39,943 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218399943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218399943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218399943"}]},"ts":"1690218399943"} 2023-07-24 17:06:39,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 79304ecd9bbcd3cab308fd287d20d9a5, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:06:39,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 8fe240f49e59394784a8210436e8cb15, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:06:40,102 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:40,102 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:06:40,106 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:06:40,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:40,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:40,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79304ecd9bbcd3cab308fd287d20d9a5, NAME => 'testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:06:40,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fe240f49e59394784a8210436e8cb15, NAME => 'testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:06:40,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. service=AccessControlService 2023-07-24 17:06:40,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. service=AccessControlService 2023-07-24 17:06:40,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:40,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:40,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:40,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:40,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:40,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:40,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:40,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:40,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:40,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:40,124 INFO [StoreOpener-8fe240f49e59394784a8210436e8cb15-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:40,124 INFO [StoreOpener-79304ecd9bbcd3cab308fd287d20d9a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:40,126 DEBUG [StoreOpener-8fe240f49e59394784a8210436e8cb15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/cf 2023-07-24 17:06:40,126 DEBUG [StoreOpener-79304ecd9bbcd3cab308fd287d20d9a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/cf 2023-07-24 17:06:40,126 DEBUG [StoreOpener-8fe240f49e59394784a8210436e8cb15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/cf 2023-07-24 17:06:40,126 DEBUG [StoreOpener-79304ecd9bbcd3cab308fd287d20d9a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/cf 2023-07-24 17:06:40,131 INFO [StoreOpener-79304ecd9bbcd3cab308fd287d20d9a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79304ecd9bbcd3cab308fd287d20d9a5 columnFamilyName cf 2023-07-24 17:06:40,131 INFO [StoreOpener-8fe240f49e59394784a8210436e8cb15-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fe240f49e59394784a8210436e8cb15 columnFamilyName cf 2023-07-24 17:06:40,135 INFO [StoreOpener-8fe240f49e59394784a8210436e8cb15-1] regionserver.HStore(310): Store=8fe240f49e59394784a8210436e8cb15/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:40,136 INFO [StoreOpener-79304ecd9bbcd3cab308fd287d20d9a5-1] regionserver.HStore(310): Store=79304ecd9bbcd3cab308fd287d20d9a5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:40,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:40,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:40,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:40,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:40,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:40,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:40,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:40,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8fe240f49e59394784a8210436e8cb15; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66899621, jitterRate=-0.003117963671684265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:40,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8fe240f49e59394784a8210436e8cb15: 2023-07-24 17:06:40,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:40,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15., pid=16, masterSystemTime=1690218400102 2023-07-24 17:06:40,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79304ecd9bbcd3cab308fd287d20d9a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58788653, jitterRate=-0.1239808052778244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:40,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79304ecd9bbcd3cab308fd287d20d9a5: 2023-07-24 17:06:40,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5., pid=15, masterSystemTime=1690218400099 2023-07-24 17:06:40,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:40,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:40,172 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8fe240f49e59394784a8210436e8cb15, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:40,172 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218400172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218400172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218400172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218400172"}]},"ts":"1690218400172"} 2023-07-24 17:06:40,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:40,173 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=79304ecd9bbcd3cab308fd287d20d9a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:40,175 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218400173"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218400173"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218400173"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218400173"}]},"ts":"1690218400173"} 2023-07-24 17:06:40,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:40,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-24 17:06:40,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 8fe240f49e59394784a8210436e8cb15, server=jenkins-hbase4.apache.org,45037,1690218390043 in 229 msec 2023-07-24 17:06:40,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-24 17:06:40,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 79304ecd9bbcd3cab308fd287d20d9a5, server=jenkins-hbase4.apache.org,40941,1690218389929 in 232 msec 2023-07-24 17:06:40,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8fe240f49e59394784a8210436e8cb15, ASSIGN in 400 msec 2023-07-24 17:06:40,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-24 17:06:40,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79304ecd9bbcd3cab308fd287d20d9a5, ASSIGN in 402 msec 2023-07-24 17:06:40,191 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:06:40,192 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218400191"}]},"ts":"1690218400191"} 2023-07-24 17:06:40,194 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 17:06:40,198 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:06:40,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:40,204 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 17:06:40,221 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 17:06:40,254 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:40,254 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:40,254 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:40,254 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:06:40,254 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:40,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:40,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:40,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:40,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:40,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 692 msec 2023-07-24 17:06:40,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 17:06:40,701 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 17:06:40,706 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 17:06:40,707 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:40,710 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:40,741 DEBUG [hconnection-0x4f1da2dd-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:40,747 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:40,771 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:40,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218400771 (current time:1690218400771). 2023-07-24 17:06:40,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:06:40,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x3b4cd0b4 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:40,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7909e6a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:40,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:40,788 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:40,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b4cd0b4 to 127.0.0.1:49485 2023-07-24 17:06:40,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:40,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x3ee0cb57 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:40,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5aa6336c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:40,805 DEBUG [hconnection-0x5c2000a4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:40,809 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:40,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ee0cb57 to 127.0.0.1:49485 2023-07-24 17:06:40,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:40,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 17:06:40,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:06:40,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:40,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:40,893 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:40,899 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690219000899 2023-07-24 17:06:40,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:40,902 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 17:06:40,904 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:40,911 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:06:40,912 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:06:40,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:40,916 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 25 msec 2023-07-24 17:06:40,918 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:40,920 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690219000920 2023-07-24 17:06:40,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,976 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 17:06:40,976 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:40,977 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 17:06:40,977 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 17:06:40,977 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,977 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,983 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:40,983 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:40,983 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:40,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:40,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:40,983 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:40,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,985 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:40,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,985 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:40,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 17:06:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 17:06:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 17:06:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:40,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:40,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:40,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:40,991 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:40,991 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:40,991 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:40,991 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:40,991 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:40,991 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:40,993 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:40,994 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:40,992 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:06:40,994 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:40,995 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:40,995 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:41,001 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,004 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,005 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,004 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:41,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 17:06:41,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@691658c7[Count = 1] remaining members to acquire global barrier 2023-07-24 17:06:41,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,012 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:41,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 17:06:41,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@691658c7[Count = 0] remaining members to acquire global barrier 2023-07-24 17:06:41,012 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 17:06:41,012 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,015 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,015 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,015 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,015 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:41,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,016 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,016 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:41,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:41,016 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:41,017 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:41,017 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:06:41,017 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,017 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:06:41,017 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:41,017 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:41,017 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:41,018 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. started... 2023-07-24 17:06:41,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:41,018 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:06:41,020 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79304ecd9bbcd3cab308fd287d20d9a5: 2023-07-24 17:06:41,021 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,024 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:41,024 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:41,024 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:41,024 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. started... 2023-07-24 17:06:41,024 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:41,025 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,025 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fe240f49e59394784a8210436e8cb15: 2023-07-24 17:06:41,025 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:41,026 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,031 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:41,031 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:41,037 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:06:41,037 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:06:41,079 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. completed. 2023-07-24 17:06:41,080 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:41,080 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:41,080 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:41,080 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,083 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:41,083 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:06:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:41,088 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,091 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. completed. 2023-07-24 17:06:41,091 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:41,091 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:41,091 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:41,091 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:41,092 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:06:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,094 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:41,094 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,094 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,095 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:41,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:06:41,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 17:06:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:06:41,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 17:06:41,111 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 17:06:41,111 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:06:41,111 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:06:41,112 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,112 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:06:41,115 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,115 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,115 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,115 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,115 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,116 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,116 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,116 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,117 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,117 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,119 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,120 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,121 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,134 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,134 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,134 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,134 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,134 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,135 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,135 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,135 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,136 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 17:06:41,135 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,135 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,136 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:06:41,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,136 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,136 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 17:06:41,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,219 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:41,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:41,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:41,221 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:06:41,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 17:06:41,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,239 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:41,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690218400902Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690218401155 (+253 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690218401155Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690218401155Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690218401169 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690218401190 (+21 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690218401238 (+48 ms) 2023-07-24 17:06:41,240 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:41,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 336 msec 2023-07-24 17:06:41,522 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:41,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:41,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:06:41,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40941] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:06:41,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:06:41,545 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 17:06:41,545 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:41,545 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:41,563 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:41,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218401563 (current time:1690218401563). 2023-07-24 17:06:41,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:06:41,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x28df919f to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:41,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fbfa5fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:41,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:41,573 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:41,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28df919f to 127.0.0.1:49485 2023-07-24 17:06:41,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:41,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x13b52484 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:41,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47321c04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:41,583 DEBUG [hconnection-0x6580d952-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:41,586 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:41,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13b52484 to 127.0.0.1:49485 2023-07-24 17:06:41,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:41,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 17:06:41,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:06:41,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:41,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:41,597 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:41,598 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690219001598 2023-07-24 17:06:41,598 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 17:06:41,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 17:06:41,602 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:06:41,602 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:06:41,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:41,609 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 17:06:41,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-24 17:06:41,613 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:41,614 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690219001614 2023-07-24 17:06:41,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 17:06:41,635 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 17:06:41,635 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:41,636 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 17:06:41,636 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 17:06:41,636 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,636 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,638 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,638 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,638 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,638 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,639 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,639 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,640 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,640 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:06:41,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 17:06:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,641 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:41,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 17:06:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:41,643 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:41,643 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:41,643 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 17:06:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 17:06:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,643 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:41,644 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 17:06:41,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 17:06:41,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 17:06:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 17:06:41,646 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:41,646 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:41,646 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:41,646 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:41,647 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 17:06:41,647 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 17:06:41,647 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 17:06:41,647 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:41,649 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,649 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,650 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 17:06:41,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de5b3f0[Count = 1] remaining members to acquire global barrier 2023-07-24 17:06:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 17:06:41,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de5b3f0[Count = 0] remaining members to acquire global barrier 2023-07-24 17:06:41,655 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 17:06:41,655 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,661 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,661 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,661 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,661 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:41,661 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:41,661 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,661 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:41,661 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:41,661 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:41,662 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:41,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,662 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. started... 2023-07-24 17:06:41,662 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. started... 2023-07-24 17:06:41,661 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:41,661 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:41,662 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 17:06:41,662 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:41,662 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:06:41,662 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8fe240f49e59394784a8210436e8cb15 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-24 17:06:41,662 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,662 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:06:41,662 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 79304ecd9bbcd3cab308fd287d20d9a5 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-24 17:06:41,665 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:41,665 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,665 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:41,703 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:41,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:41,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:41,704 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:06:41,852 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724eaae5cdc50b947dd888e71dc3fa2d883 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724eaae5cdc50b947dd888e71dc3fa2d883 2023-07-24 17:06:41,852 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724841474b6ce3a46519e1772a705e3c4f1 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724841474b6ce3a46519e1772a705e3c4f1 2023-07-24 17:06:41,890 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/.tmp/cf/17eb6ae676e34a2da0be0377c0c53554 2023-07-24 17:06:41,891 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/.tmp/cf/fd3d15c602664033b34106904e9fde46 2023-07-24 17:06:41,902 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/.tmp/cf/fd3d15c602664033b34106904e9fde46 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/cf/fd3d15c602664033b34106904e9fde46 2023-07-24 17:06:41,902 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/.tmp/cf/17eb6ae676e34a2da0be0377c0c53554 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/cf/17eb6ae676e34a2da0be0377c0c53554 2023-07-24 17:06:41,904 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:41,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:41,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:41,908 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:06:41,913 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/cf/17eb6ae676e34a2da0be0377c0c53554, entries=7, sequenceid=6, filesize=6.1 K 2023-07-24 17:06:41,913 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/cf/fd3d15c602664033b34106904e9fde46, entries=43, sequenceid=6, filesize=12.1 K 2023-07-24 17:06:41,916 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 79304ecd9bbcd3cab308fd287d20d9a5 in 254ms, sequenceid=6, compaction requested=false 2023-07-24 17:06:41,916 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 17:06:41,916 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 8fe240f49e59394784a8210436e8cb15 in 254ms, sequenceid=6, compaction requested=false 2023-07-24 17:06:41,916 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 17:06:41,918 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79304ecd9bbcd3cab308fd287d20d9a5: 2023-07-24 17:06:41,918 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fe240f49e59394784a8210436e8cb15: 2023-07-24 17:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 17:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 17:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/cf/17eb6ae676e34a2da0be0377c0c53554] hfiles 2023-07-24 17:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/cf/17eb6ae676e34a2da0be0377c0c53554 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 17:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/cf/fd3d15c602664033b34106904e9fde46] hfiles 2023-07-24 17:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/cf/fd3d15c602664033b34106904e9fde46 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 17:06:41,945 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. completed. 2023-07-24 17:06:41,945 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:41,945 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. completed. 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,945 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 17:06:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:06:41,947 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:41,948 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 17:06:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 17:06:41,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:06:41,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 17:06:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:06:41,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 17:06:41,957 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 17:06:41,957 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:06:41,957 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:06:41,957 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 17:06:41,957 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:06:41,960 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,960 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,960 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,961 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:41,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,961 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,960 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:41,961 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,961 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,962 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:41,963 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 17:06:41,965 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,965 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,965 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:41,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 17:06:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,977 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:41,977 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:41,979 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 17:06:41,979 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:41,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:41,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 17:06:41,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:06:41,979 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,980 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:41,980 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:41,980 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,980 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 17:06:41,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724eaae5cdc50b947dd888e71dc3fa2d883, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724841474b6ce3a46519e1772a705e3c4f1] mob files 2023-07-24 17:06:41,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724eaae5cdc50b947dd888e71dc3fa2d883 2023-07-24 17:06:41,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724841474b6ce3a46519e1772a705e3c4f1 2023-07-24 17:06:41,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 17:06:41,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 17:06:42,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 17:06:42,074 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 17:06:42,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 17:06:42,074 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 17:06:42,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690218401598Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690218401994 (+396 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690218401994Loading Region manifests for snaptb0-testExportWithTargetName at 1690218401995 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1690218402000 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690218402016 (+16 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690218402074 (+58 ms) 2023-07-24 17:06:42,076 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 17:06:42,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 477 msec 2023-07-24 17:06:42,208 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:42,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 17:06:42,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:06:42,212 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212 2023-07-24 17:06:42,213 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45525, tgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212, rawTgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212, srcFsUri=hdfs://localhost:45525, srcDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:06:42,266 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:06:42,266 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_284037925_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 17:06:42,266 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26, snapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 17:06:42,295 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 17:06:42,373 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,374 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,375 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,375 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,376 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,377 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,377 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,468 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop-1961319599278231742.jar 2023-07-24 17:06:42,469 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,469 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,470 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,470 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,470 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,471 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:06:42,471 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:06:42,472 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:06:42,472 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:06:42,473 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:06:42,473 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:06:42,474 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:06:42,474 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:06:42,475 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:06:42,475 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:06:42,476 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:06:42,479 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:06:42,479 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:06:42,479 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:06:42,480 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:06:42,480 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:06:42,480 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:06:42,481 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:06:43,948 WARN [Listener at jenkins-hbase4.apache.org/33193] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:06:43,954 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 17:06:43,963 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 17:06:44,458 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:06:44,460 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:06:45,240 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0001_000001 (auth:SIMPLE) 2023-07-24 17:06:45,635 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:06:50,787 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0001_000001 (auth:SIMPLE) 2023-07-24 17:06:53,063 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0001_000001 (auth:SIMPLE) 2023-07-24 17:06:56,379 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0001_000001 (auth:SIMPLE) 2023-07-24 17:06:57,892 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:06:57,894 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:06:57,908 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 17:06:57,909 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:06:57,909 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:06:57,909 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 17:06:57,910 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 17:06:57,910 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 17:06:57,910 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212/.hbase-snapshot/testExportWithTargetName 2023-07-24 17:06:57,911 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 17:06:57,911 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218402212/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 17:06:57,922 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 17:06:57,928 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 17:06:57,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:57,945 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218417945"}]},"ts":"1690218417945"} 2023-07-24 17:06:57,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 17:06:57,947 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 17:06:57,948 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 17:06:57,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79304ecd9bbcd3cab308fd287d20d9a5, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8fe240f49e59394784a8210436e8cb15, UNASSIGN}] 2023-07-24 17:06:57,953 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8fe240f49e59394784a8210436e8cb15, UNASSIGN 2023-07-24 17:06:57,953 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79304ecd9bbcd3cab308fd287d20d9a5, UNASSIGN 2023-07-24 17:06:57,954 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=79304ecd9bbcd3cab308fd287d20d9a5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:57,954 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8fe240f49e59394784a8210436e8cb15, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:57,954 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218417954"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218417954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218417954"}]},"ts":"1690218417954"} 2023-07-24 17:06:57,954 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218417954"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218417954"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218417954"}]},"ts":"1690218417954"} 2023-07-24 17:06:57,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 79304ecd9bbcd3cab308fd287d20d9a5, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:06:57,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 8fe240f49e59394784a8210436e8cb15, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:06:58,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 17:06:58,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:58,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:58,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79304ecd9bbcd3cab308fd287d20d9a5, disabling compactions & flushes 2023-07-24 17:06:58,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8fe240f49e59394784a8210436e8cb15, disabling compactions & flushes 2023-07-24 17:06:58,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:58,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:58,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:58,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:58,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. after waiting 0 ms 2023-07-24 17:06:58,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. after waiting 0 ms 2023-07-24 17:06:58,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:58,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:58,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:06:58,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:06:58,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:58,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:06:58,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15. 2023-07-24 17:06:58,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5. 2023-07-24 17:06:58,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8fe240f49e59394784a8210436e8cb15: 2023-07-24 17:06:58,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79304ecd9bbcd3cab308fd287d20d9a5: 2023-07-24 17:06:58,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:58,140 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8fe240f49e59394784a8210436e8cb15, regionState=CLOSED 2023-07-24 17:06:58,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:58,141 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218418140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218418140"}]},"ts":"1690218418140"} 2023-07-24 17:06:58,144 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=79304ecd9bbcd3cab308fd287d20d9a5, regionState=CLOSED 2023-07-24 17:06:58,144 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690218418144"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218418144"}]},"ts":"1690218418144"} 2023-07-24 17:06:58,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 17:06:58,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 8fe240f49e59394784a8210436e8cb15, server=jenkins-hbase4.apache.org,45037,1690218390043 in 185 msec 2023-07-24 17:06:58,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8fe240f49e59394784a8210436e8cb15, UNASSIGN in 196 msec 2023-07-24 17:06:58,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 17:06:58,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 79304ecd9bbcd3cab308fd287d20d9a5, server=jenkins-hbase4.apache.org,40941,1690218389929 in 190 msec 2023-07-24 17:06:58,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-24 17:06:58,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=79304ecd9bbcd3cab308fd287d20d9a5, UNASSIGN in 200 msec 2023-07-24 17:06:58,155 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218418155"}]},"ts":"1690218418155"} 2023-07-24 17:06:58,156 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 17:06:58,159 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 17:06:58,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 227 msec 2023-07-24 17:06:58,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 17:06:58,248 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 17:06:58,254 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 17:06:58,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,264 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 17:06:58,266 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,269 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 17:06:58,273 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:58,273 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:58,275 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 17:06:58,275 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 17:06:58,275 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 17:06:58,276 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 17:06:58,276 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/recovered.edits] 2023-07-24 17:06:58,276 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/recovered.edits] 2023-07-24 17:06:58,277 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 17:06:58,278 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 17:06:58,278 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,279 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,279 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 17:06:58,279 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:06:58,279 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 17:06:58,279 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:06:58,278 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,279 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,279 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 17:06:58,279 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:06:58,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 17:06:58,289 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/cf/17eb6ae676e34a2da0be0377c0c53554 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/cf/17eb6ae676e34a2da0be0377c0c53554 2023-07-24 17:06:58,289 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/cf/fd3d15c602664033b34106904e9fde46 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/cf/fd3d15c602664033b34106904e9fde46 2023-07-24 17:06:58,294 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5/recovered.edits/9.seqid 2023-07-24 17:06:58,295 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15/recovered.edits/9.seqid 2023-07-24 17:06:58,295 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/79304ecd9bbcd3cab308fd287d20d9a5 2023-07-24 17:06:58,295 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportWithTargetName/8fe240f49e59394784a8210436e8cb15 2023-07-24 17:06:58,296 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 17:06:58,298 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 17:06:58,300 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-24 17:06:58,306 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724eaae5cdc50b947dd888e71dc3fa2d883 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724eaae5cdc50b947dd888e71dc3fa2d883 2023-07-24 17:06:58,308 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724841474b6ce3a46519e1772a705e3c4f1 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724841474b6ce3a46519e1772a705e3c4f1 2023-07-24 17:06:58,309 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 17:06:58,313 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,339 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 17:06:58,343 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 17:06:58,344 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,345 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 17:06:58,345 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218418345"}]},"ts":"9223372036854775807"} 2023-07-24 17:06:58,345 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218418345"}]},"ts":"9223372036854775807"} 2023-07-24 17:06:58,348 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:06:58,348 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 79304ecd9bbcd3cab308fd287d20d9a5, NAME => 'testtb-testExportWithTargetName,,1690218399576.79304ecd9bbcd3cab308fd287d20d9a5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8fe240f49e59394784a8210436e8cb15, NAME => 'testtb-testExportWithTargetName,1,1690218399576.8fe240f49e59394784a8210436e8cb15.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:06:58,348 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 17:06:58,348 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218418348"}]},"ts":"9223372036854775807"} 2023-07-24 17:06:58,350 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 17:06:58,354 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 17:06:58,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 99 msec 2023-07-24 17:06:58,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 17:06:58,386 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 17:06:58,409 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 17:06:58,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 17:06:58,415 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 17:06:58,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 17:06:58,455 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=748 (was 704) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:49764 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:35987 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:35245 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_998697800_17 at /127.0.0.1:55712 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-561878478_1 at /127.0.0.1:49730 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:36786 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=915 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 174) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=6006 (was 7753) 2023-07-24 17:06:58,456 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-24 17:06:58,481 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=748, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=235, ProcessCount=179, AvailableMemoryMB=6005 2023-07-24 17:06:58,481 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-24 17:06:58,484 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 17:06:58,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:06:58,495 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:06:58,496 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 17:06:58,498 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:06:58,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 17:06:58,501 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:06:58,501 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163 2023-07-24 17:06:58,501 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9 empty. 2023-07-24 17:06:58,501 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163 empty. 2023-07-24 17:06:58,502 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:06:58,502 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163 2023-07-24 17:06:58,502 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 17:06:58,521 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 17:06:58,523 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9fc786631282009f90ac70f24c67cdb9, NAME => 'testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:06:58,523 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 56169160ba7038d7c158ae7b65726163, NAME => 'testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:06:58,551 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:58,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9fc786631282009f90ac70f24c67cdb9, disabling compactions & flushes 2023-07-24 17:06:58,552 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:58,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:58,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. after waiting 0 ms 2023-07-24 17:06:58,552 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:58,553 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:58,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9fc786631282009f90ac70f24c67cdb9: 2023-07-24 17:06:58,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:58,554 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 56169160ba7038d7c158ae7b65726163, disabling compactions & flushes 2023-07-24 17:06:58,554 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:58,554 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:58,554 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. after waiting 0 ms 2023-07-24 17:06:58,554 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:58,554 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:58,554 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 56169160ba7038d7c158ae7b65726163: 2023-07-24 17:06:58,557 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:06:58,558 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418557"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218418557"}]},"ts":"1690218418557"} 2023-07-24 17:06:58,558 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418557"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218418557"}]},"ts":"1690218418557"} 2023-07-24 17:06:58,560 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:06:58,561 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:06:58,561 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218418561"}]},"ts":"1690218418561"} 2023-07-24 17:06:58,563 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 17:06:58,567 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:06:58,568 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:06:58,568 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:06:58,568 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:06:58,568 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:06:58,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9fc786631282009f90ac70f24c67cdb9, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=56169160ba7038d7c158ae7b65726163, ASSIGN}] 2023-07-24 17:06:58,571 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9fc786631282009f90ac70f24c67cdb9, ASSIGN 2023-07-24 17:06:58,571 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=56169160ba7038d7c158ae7b65726163, ASSIGN 2023-07-24 17:06:58,572 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9fc786631282009f90ac70f24c67cdb9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45037,1690218390043; forceNewPlan=false, retain=false 2023-07-24 17:06:58,572 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=56169160ba7038d7c158ae7b65726163, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40941,1690218389929; forceNewPlan=false, retain=false 2023-07-24 17:06:58,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 17:06:58,722 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:06:58,724 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=56169160ba7038d7c158ae7b65726163, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:58,724 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9fc786631282009f90ac70f24c67cdb9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:58,725 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418724"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218418724"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218418724"}]},"ts":"1690218418724"} 2023-07-24 17:06:58,725 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418724"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218418724"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218418724"}]},"ts":"1690218418724"} 2023-07-24 17:06:58,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 56169160ba7038d7c158ae7b65726163, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:06:58,728 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 9fc786631282009f90ac70f24c67cdb9, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:06:58,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 17:06:58,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:58,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:58,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 56169160ba7038d7c158ae7b65726163, NAME => 'testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:06:58,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9fc786631282009f90ac70f24c67cdb9, NAME => 'testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:06:58,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. service=AccessControlService 2023-07-24 17:06:58,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:58,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 56169160ba7038d7c158ae7b65726163 2023-07-24 17:06:58,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:58,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 56169160ba7038d7c158ae7b65726163 2023-07-24 17:06:58,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 56169160ba7038d7c158ae7b65726163 2023-07-24 17:06:58,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. service=AccessControlService 2023-07-24 17:06:58,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:06:58,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:06:58,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:06:58,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:06:58,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:06:58,887 INFO [StoreOpener-9fc786631282009f90ac70f24c67cdb9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:06:58,888 INFO [StoreOpener-56169160ba7038d7c158ae7b65726163-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 56169160ba7038d7c158ae7b65726163 2023-07-24 17:06:58,890 DEBUG [StoreOpener-9fc786631282009f90ac70f24c67cdb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/cf 2023-07-24 17:06:58,890 DEBUG [StoreOpener-9fc786631282009f90ac70f24c67cdb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/cf 2023-07-24 17:06:58,890 INFO [StoreOpener-9fc786631282009f90ac70f24c67cdb9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fc786631282009f90ac70f24c67cdb9 columnFamilyName cf 2023-07-24 17:06:58,891 DEBUG [StoreOpener-56169160ba7038d7c158ae7b65726163-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/cf 2023-07-24 17:06:58,891 DEBUG [StoreOpener-56169160ba7038d7c158ae7b65726163-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/cf 2023-07-24 17:06:58,891 INFO [StoreOpener-56169160ba7038d7c158ae7b65726163-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56169160ba7038d7c158ae7b65726163 columnFamilyName cf 2023-07-24 17:06:58,893 INFO [StoreOpener-56169160ba7038d7c158ae7b65726163-1] regionserver.HStore(310): Store=56169160ba7038d7c158ae7b65726163/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:58,893 INFO [StoreOpener-9fc786631282009f90ac70f24c67cdb9-1] regionserver.HStore(310): Store=9fc786631282009f90ac70f24c67cdb9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:06:58,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163 2023-07-24 17:06:58,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163 2023-07-24 17:06:58,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:06:58,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:06:58,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 56169160ba7038d7c158ae7b65726163 2023-07-24 17:06:58,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:06:58,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:58,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 56169160ba7038d7c158ae7b65726163; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66351608, jitterRate=-0.0112839937210083}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:58,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 56169160ba7038d7c158ae7b65726163: 2023-07-24 17:06:58,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163., pid=30, masterSystemTime=1690218418879 2023-07-24 17:06:58,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:06:58,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:58,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:58,910 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=56169160ba7038d7c158ae7b65726163, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:58,910 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418910"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218418910"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218418910"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218418910"}]},"ts":"1690218418910"} 2023-07-24 17:06:58,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9fc786631282009f90ac70f24c67cdb9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59301627, jitterRate=-0.1163368970155716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:06:58,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9fc786631282009f90ac70f24c67cdb9: 2023-07-24 17:06:58,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9., pid=31, masterSystemTime=1690218418880 2023-07-24 17:06:58,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:58,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:58,919 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9fc786631282009f90ac70f24c67cdb9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:58,921 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218418919"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218418919"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218418919"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218418919"}]},"ts":"1690218418919"} 2023-07-24 17:06:58,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-24 17:06:58,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 56169160ba7038d7c158ae7b65726163, server=jenkins-hbase4.apache.org,40941,1690218389929 in 186 msec 2023-07-24 17:06:58,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=56169160ba7038d7c158ae7b65726163, ASSIGN in 353 msec 2023-07-24 17:06:58,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-24 17:06:58,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 9fc786631282009f90ac70f24c67cdb9, server=jenkins-hbase4.apache.org,45037,1690218390043 in 196 msec 2023-07-24 17:06:58,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-24 17:06:58,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9fc786631282009f90ac70f24c67cdb9, ASSIGN in 358 msec 2023-07-24 17:06:58,930 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:06:58,930 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218418930"}]},"ts":"1690218418930"} 2023-07-24 17:06:58,932 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 17:06:58,935 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:06:58,936 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 17:06:58,937 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:06:58,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:06:58,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:58,941 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:58,941 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:58,941 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:06:58,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 455 msec 2023-07-24 17:06:59,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 17:06:59,104 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 17:06:59,108 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 17:06:59,108 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:59,111 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:59,142 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218419142 (current time:1690218419142). 2023-07-24 17:06:59,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:06:59,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x59b65a4b to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:59,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71ccc02a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:59,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:59,159 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:59,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59b65a4b to 127.0.0.1:49485 2023-07-24 17:06:59,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:59,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x4cdff4e1 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:59,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27509b33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:59,171 DEBUG [hconnection-0x300ad263-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:59,172 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:59,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cdff4e1 to 127.0.0.1:49485 2023-07-24 17:06:59,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:59,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:06:59,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:06:59,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,185 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,187 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690219019187 2023-07-24 17:06:59,187 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 17:06:59,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,188 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:06:59,188 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:06:59,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,195 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-24 17:06:59,198 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,199 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690219019199 2023-07-24 17:06:59,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,226 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 17:06:59,226 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,228 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 17:06:59,228 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 17:06:59,229 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,229 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,230 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,230 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,230 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,231 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,231 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,231 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,231 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,231 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:06:59,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 17:06:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 17:06:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 17:06:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,234 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,235 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,235 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,240 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,240 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,240 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,240 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,240 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,240 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,241 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,240 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,241 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,242 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,242 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,243 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,243 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,244 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,248 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,248 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,248 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,248 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,248 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,248 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,248 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,249 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,249 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,249 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 17:06:59,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13367d2d[Count = 1] remaining members to acquire global barrier 2023-07-24 17:06:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 17:06:59,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13367d2d[Count = 0] remaining members to acquire global barrier 2023-07-24 17:06:59,254 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 17:06:59,254 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,256 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,256 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,256 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,257 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:59,257 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:59,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,257 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. started... 2023-07-24 17:06:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,257 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:06:59,257 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9fc786631282009f90ac70f24c67cdb9: 2023-07-24 17:06:59,258 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:59,257 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:06:59,258 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,258 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:59,258 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:59,258 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. started... 2023-07-24 17:06:59,258 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:06:59,260 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 56169160ba7038d7c158ae7b65726163: 2023-07-24 17:06:59,260 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,260 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:59,260 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:06:59,260 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,260 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,260 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,289 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:59,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:06:59,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:59,294 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:06:59,295 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. completed. 2023-07-24 17:06:59,295 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:59,295 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:59,295 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:59,295 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,295 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,295 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. completed. 2023-07-24 17:06:59,295 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:59,295 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:06:59,295 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:59,295 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:59,295 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,295 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,296 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:06:59,301 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,301 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,301 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,301 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,307 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,307 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,307 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,307 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:06:59,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 17:06:59,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:06:59,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 17:06:59,326 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 17:06:59,326 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:06:59,326 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:06:59,326 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,326 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:06:59,334 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,334 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,334 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,334 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,334 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,334 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,334 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,336 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,338 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,338 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,342 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,342 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,343 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,347 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,347 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,347 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,347 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,348 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,348 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,348 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,348 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,348 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,348 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,348 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,348 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,348 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,348 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,348 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 17:06:59,349 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:06:59,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,349 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,349 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,351 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 17:06:59,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,455 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 17:06:59,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,456 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 17:06:59,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690218419187Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690218419377 (+190 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690218419378 (+1 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690218419378Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690218419383 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690218419397 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690218419455 (+58 ms) 2023-07-24 17:06:59,459 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 268 msec 2023-07-24 17:06:59,494 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:59,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:06:59,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:06:59,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:06:59,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40941] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:06:59,509 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 17:06:59,509 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:59,509 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:06:59,520 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218419520 (current time:1690218419520). 2023-07-24 17:06:59,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:06:59,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x4a5595fb to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:59,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28a04871, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:59,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:59,531 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:59,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a5595fb to 127.0.0.1:49485 2023-07-24 17:06:59,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:59,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x5fa33603 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:06:59,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1376aed7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:06:59,542 DEBUG [hconnection-0x593d50c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:06:59,544 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:06:59,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fa33603 to 127.0.0.1:49485 2023-07-24 17:06:59,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:06:59,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:06:59,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:06:59,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,553 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,554 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690219019554 2023-07-24 17:06:59,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:06:59,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 17:06:59,556 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:06:59,556 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:06:59,557 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:06:59,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 17:06:59,559 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,560 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690219019560 2023-07-24 17:06:59,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 17:06:59,571 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 17:06:59,572 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,572 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 17:06:59,572 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 17:06:59,573 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,573 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,574 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,574 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,574 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,574 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,575 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,575 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,575 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,575 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:06:59,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 17:06:59,576 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,576 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,576 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,576 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,577 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 17:06:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 17:06:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:06:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,579 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,579 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 17:06:59,579 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 17:06:59,579 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 17:06:59,581 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,581 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,581 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,582 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,583 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,583 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,583 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:06:59,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 17:06:59,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50eef604[Count = 1] remaining members to acquire global barrier 2023-07-24 17:06:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 17:06:59,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50eef604[Count = 0] remaining members to acquire global barrier 2023-07-24 17:06:59,586 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 17:06:59,586 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,587 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,587 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,587 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,588 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,588 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:59,588 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,588 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,588 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:06:59,588 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,588 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,588 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:06:59,588 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:06:59,588 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:59,588 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:59,588 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:06:59,588 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. started... 2023-07-24 17:06:59,588 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. started... 2023-07-24 17:06:59,589 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,589 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:06:59,589 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 56169160ba7038d7c158ae7b65726163 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 17:06:59,589 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9fc786631282009f90ac70f24c67cdb9 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 17:06:59,590 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,590 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,590 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,615 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724a76c6c6e2a594e32a4760179261878f3 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724a76c6c6e2a594e32a4760179261878f3 2023-07-24 17:06:59,615 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072462b2bd3eb7d94b60820348a64935e097 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072462b2bd3eb7d94b60820348a64935e097 2023-07-24 17:06:59,632 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/.tmp/cf/f530fbe7242d4c1eabf9f41934c41917 2023-07-24 17:06:59,632 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/.tmp/cf/baf240825b7d431688dfcf5e1f72023a 2023-07-24 17:06:59,644 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/.tmp/cf/baf240825b7d431688dfcf5e1f72023a as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/cf/baf240825b7d431688dfcf5e1f72023a 2023-07-24 17:06:59,644 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/.tmp/cf/f530fbe7242d4c1eabf9f41934c41917 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/cf/f530fbe7242d4c1eabf9f41934c41917 2023-07-24 17:06:59,650 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/cf/f530fbe7242d4c1eabf9f41934c41917, entries=45, sequenceid=6, filesize=12.5 K 2023-07-24 17:06:59,651 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 56169160ba7038d7c158ae7b65726163 in 62ms, sequenceid=6, compaction requested=false 2023-07-24 17:06:59,651 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 17:06:59,652 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 56169160ba7038d7c158ae7b65726163: 2023-07-24 17:06:59,653 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 17:06:59,653 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:59,653 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/cf/baf240825b7d431688dfcf5e1f72023a, entries=5, sequenceid=6, filesize=5.7 K 2023-07-24 17:06:59,653 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/cf/f530fbe7242d4c1eabf9f41934c41917] hfiles 2023-07-24 17:06:59,653 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/cf/f530fbe7242d4c1eabf9f41934c41917 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 17:06:59,654 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 9fc786631282009f90ac70f24c67cdb9 in 65ms, sequenceid=6, compaction requested=false 2023-07-24 17:06:59,655 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9fc786631282009f90ac70f24c67cdb9: 2023-07-24 17:06:59,655 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 17:06:59,655 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:06:59,655 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/cf/baf240825b7d431688dfcf5e1f72023a] hfiles 2023-07-24 17:06:59,655 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/cf/baf240825b7d431688dfcf5e1f72023a for snapshot=snaptb0-testExportFileSystemState 2023-07-24 17:06:59,656 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:59,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:06:59,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:06:59,657 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:06:59,663 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. completed. 2023-07-24 17:06:59,663 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:06:59,663 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:59,663 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:59,663 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,663 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,663 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:06:59,663 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. completed. 2023-07-24 17:06:59,663 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:06:59,663 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:06:59,663 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:06:59,664 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,664 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 17:06:59,664 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:06:59,669 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,669 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,669 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,669 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,671 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 17:06:59,671 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,671 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,671 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 17:06:59,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:06:59,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 17:06:59,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:06:59,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 17:06:59,679 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 17:06:59,679 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:06:59,679 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:06:59,679 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 17:06:59,679 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:06:59,680 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,680 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,681 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:06:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:06:59,681 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,681 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:06:59,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,682 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,682 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:06:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,684 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:06:59,685 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 17:06:59,685 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:06:59,688 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:06:59,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,688 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 17:06:59,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,688 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:06:59,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:06:59,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,690 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 17:06:59,690 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:06:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:06:59,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 17:06:59,690 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:06:59,691 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:06:59,691 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:06:59,691 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,691 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:06:59,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:06:59,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724a76c6c6e2a594e32a4760179261878f3, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072462b2bd3eb7d94b60820348a64935e097] mob files 2023-07-24 17:06:59,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724a76c6c6e2a594e32a4760179261878f3 2023-07-24 17:06:59,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072462b2bd3eb7d94b60820348a64935e097 2023-07-24 17:06:59,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 17:06:59,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 17:06:59,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,785 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690218419555Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690218419700 (+145 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690218419700Loading Region manifests for snaptb0-testExportFileSystemState at 1690218419700Writing data manifest for snaptb0-testExportFileSystemState at 1690218419708 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690218419729 (+21 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690218419784 (+55 ms) 2023-07-24 17:06:59,788 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 17:06:59,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 232 msec 2023-07-24 17:06:59,857 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:06:59,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:06:59,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:06:59,859 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859 2023-07-24 17:06:59,859 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45525, tgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859, rawTgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859, srcFsUri=hdfs://localhost:45525, srcDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:06:59,889 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:06:59,889 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_299559966_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:06:59,889 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26, snapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 17:06:59,906 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 17:07:00,356 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,357 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,357 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,358 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,358 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,358 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,359 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,442 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop-1053784082456962542.jar 2023-07-24 17:07:00,443 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,443 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,444 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,444 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,444 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,445 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:00,445 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:07:00,446 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:07:00,446 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:07:00,447 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:07:00,447 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:07:00,448 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:07:00,449 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:07:00,449 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:07:00,450 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:07:00,451 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:07:00,451 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:00,452 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:00,452 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:00,453 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:00,453 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:00,454 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:00,454 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:01,025 WARN [Listener at jenkins-hbase4.apache.org/33193] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:07:01,028 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 17:07:01,031 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 17:07:02,583 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:07:02,583 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:07:02,589 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0001_000001 (auth:SIMPLE) 2023-07-24 17:07:03,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:03,728 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:07:38,607 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:40,873 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:43,941 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:45,322 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:07:45,326 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:07:45,337 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 17:07:45,338 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:07:45,340 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:07:45,340 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 17:07:45,341 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 17:07:45,341 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 17:07:45,341 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 17:07:45,342 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 17:07:45,342 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218419859/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 17:07:45,360 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 17:07:45,361 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 17:07:45,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 17:07:45,371 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218465371"}]},"ts":"1690218465371"} 2023-07-24 17:07:45,372 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 17:07:45,374 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 17:07:45,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9fc786631282009f90ac70f24c67cdb9, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=56169160ba7038d7c158ae7b65726163, UNASSIGN}] 2023-07-24 17:07:45,378 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9fc786631282009f90ac70f24c67cdb9, UNASSIGN 2023-07-24 17:07:45,378 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=56169160ba7038d7c158ae7b65726163, UNASSIGN 2023-07-24 17:07:45,379 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9fc786631282009f90ac70f24c67cdb9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:45,379 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=56169160ba7038d7c158ae7b65726163, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:45,379 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218465379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218465379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218465379"}]},"ts":"1690218465379"} 2023-07-24 17:07:45,379 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218465379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218465379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218465379"}]},"ts":"1690218465379"} 2023-07-24 17:07:45,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9fc786631282009f90ac70f24c67cdb9, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:07:45,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 56169160ba7038d7c158ae7b65726163, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:07:45,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 17:07:45,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:07:45,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9fc786631282009f90ac70f24c67cdb9, disabling compactions & flushes 2023-07-24 17:07:45,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:07:45,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:07:45,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. after waiting 0 ms 2023-07-24 17:07:45,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:07:45,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 56169160ba7038d7c158ae7b65726163 2023-07-24 17:07:45,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 56169160ba7038d7c158ae7b65726163, disabling compactions & flushes 2023-07-24 17:07:45,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:07:45,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:07:45,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. after waiting 0 ms 2023-07-24 17:07:45,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:07:45,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:07:45,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:07:45,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:07:45,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:07:45,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9. 2023-07-24 17:07:45,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163. 2023-07-24 17:07:45,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9fc786631282009f90ac70f24c67cdb9: 2023-07-24 17:07:45,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 56169160ba7038d7c158ae7b65726163: 2023-07-24 17:07:45,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:07:45,557 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9fc786631282009f90ac70f24c67cdb9, regionState=CLOSED 2023-07-24 17:07:45,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 56169160ba7038d7c158ae7b65726163 2023-07-24 17:07:45,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218465557"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218465557"}]},"ts":"1690218465557"} 2023-07-24 17:07:45,558 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=56169160ba7038d7c158ae7b65726163, regionState=CLOSED 2023-07-24 17:07:45,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690218465558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218465558"}]},"ts":"1690218465558"} 2023-07-24 17:07:45,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-24 17:07:45,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9fc786631282009f90ac70f24c67cdb9, server=jenkins-hbase4.apache.org,45037,1690218390043 in 179 msec 2023-07-24 17:07:45,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-24 17:07:45,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 56169160ba7038d7c158ae7b65726163, server=jenkins-hbase4.apache.org,40941,1690218389929 in 179 msec 2023-07-24 17:07:45,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9fc786631282009f90ac70f24c67cdb9, UNASSIGN in 187 msec 2023-07-24 17:07:45,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-24 17:07:45,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=56169160ba7038d7c158ae7b65726163, UNASSIGN in 188 msec 2023-07-24 17:07:45,567 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218465567"}]},"ts":"1690218465567"} 2023-07-24 17:07:45,569 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 17:07:45,572 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 17:07:45,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 212 msec 2023-07-24 17:07:45,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 17:07:45,674 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 17:07:45,674 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 17:07:45,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,679 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 17:07:45,680 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,682 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 17:07:45,685 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,685 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,685 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,685 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,685 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 17:07:45,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 17:07:45,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 17:07:45,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 17:07:45,687 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,687 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,687 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,687 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:45,687 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:45,687 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:45,687 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 17:07:45,687 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:45,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 17:07:45,689 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:07:45,689 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163 2023-07-24 17:07:45,691 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/recovered.edits] 2023-07-24 17:07:45,691 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/recovered.edits] 2023-07-24 17:07:45,697 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/cf/f530fbe7242d4c1eabf9f41934c41917 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/cf/f530fbe7242d4c1eabf9f41934c41917 2023-07-24 17:07:45,697 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/cf/baf240825b7d431688dfcf5e1f72023a to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/cf/baf240825b7d431688dfcf5e1f72023a 2023-07-24 17:07:45,701 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9/recovered.edits/9.seqid 2023-07-24 17:07:45,701 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163/recovered.edits/9.seqid 2023-07-24 17:07:45,702 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/9fc786631282009f90ac70f24c67cdb9 2023-07-24 17:07:45,702 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemState/56169160ba7038d7c158ae7b65726163 2023-07-24 17:07:45,702 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 17:07:45,703 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 17:07:45,704 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-24 17:07:45,707 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724a76c6c6e2a594e32a4760179261878f3 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724a76c6c6e2a594e32a4760179261878f3 2023-07-24 17:07:45,709 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072462b2bd3eb7d94b60820348a64935e097 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072462b2bd3eb7d94b60820348a64935e097 2023-07-24 17:07:45,710 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 17:07:45,713 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,716 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 17:07:45,721 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 17:07:45,723 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,723 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 17:07:45,723 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218465723"}]},"ts":"9223372036854775807"} 2023-07-24 17:07:45,723 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218465723"}]},"ts":"9223372036854775807"} 2023-07-24 17:07:45,729 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:07:45,729 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9fc786631282009f90ac70f24c67cdb9, NAME => 'testtb-testExportFileSystemState,,1690218418483.9fc786631282009f90ac70f24c67cdb9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 56169160ba7038d7c158ae7b65726163, NAME => 'testtb-testExportFileSystemState,1,1690218418483.56169160ba7038d7c158ae7b65726163.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:07:45,729 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 17:07:45,729 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218465729"}]},"ts":"9223372036854775807"} 2023-07-24 17:07:45,740 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 17:07:45,745 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 17:07:45,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 70 msec 2023-07-24 17:07:45,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 17:07:45,790 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 17:07:45,798 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 17:07:45,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 17:07:45,802 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 17:07:45,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 17:07:45,830 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=730 (was 748), OpenFileDescriptor=891 (was 915), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 235), ProcessCount=179 (was 179), AvailableMemoryMB=5785 (was 6005) 2023-07-24 17:07:45,830 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=730 is superior to 500 2023-07-24 17:07:45,852 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=730, OpenFileDescriptor=891, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=179, AvailableMemoryMB=5784 2023-07-24 17:07:45,852 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=730 is superior to 500 2023-07-24 17:07:45,854 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 17:07:45,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:07:45,857 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:07:45,857 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 17:07:45,858 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:07:45,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 17:07:45,861 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:07:45,861 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97 2023-07-24 17:07:45,862 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1 empty. 2023-07-24 17:07:45,862 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97 empty. 2023-07-24 17:07:45,862 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:07:45,862 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97 2023-07-24 17:07:45,862 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 17:07:45,886 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 17:07:45,887 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 79a622516d52c590ba83ebf6084d20b1, NAME => 'testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:07:45,887 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 17829ebd838c81805e47c54d618e1f97, NAME => 'testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:07:45,908 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:07:45,908 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 79a622516d52c590ba83ebf6084d20b1, disabling compactions & flushes 2023-07-24 17:07:45,908 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:45,908 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:45,908 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. after waiting 0 ms 2023-07-24 17:07:45,908 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:45,908 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:45,908 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 79a622516d52c590ba83ebf6084d20b1: 2023-07-24 17:07:45,908 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:07:45,909 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 17829ebd838c81805e47c54d618e1f97, disabling compactions & flushes 2023-07-24 17:07:45,909 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:45,909 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:45,909 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. after waiting 0 ms 2023-07-24 17:07:45,909 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:45,909 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:45,909 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 17829ebd838c81805e47c54d618e1f97: 2023-07-24 17:07:45,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:07:45,916 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218465916"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218465916"}]},"ts":"1690218465916"} 2023-07-24 17:07:45,916 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218465916"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218465916"}]},"ts":"1690218465916"} 2023-07-24 17:07:45,926 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:07:45,928 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:07:45,928 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218465928"}]},"ts":"1690218465928"} 2023-07-24 17:07:45,930 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 17:07:45,935 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:07:45,937 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:07:45,937 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:07:45,937 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:07:45,937 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:07:45,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=79a622516d52c590ba83ebf6084d20b1, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17829ebd838c81805e47c54d618e1f97, ASSIGN}] 2023-07-24 17:07:45,941 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17829ebd838c81805e47c54d618e1f97, ASSIGN 2023-07-24 17:07:45,941 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=79a622516d52c590ba83ebf6084d20b1, ASSIGN 2023-07-24 17:07:45,942 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17829ebd838c81805e47c54d618e1f97, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40941,1690218389929; forceNewPlan=false, retain=false 2023-07-24 17:07:45,944 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=79a622516d52c590ba83ebf6084d20b1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45037,1690218390043; forceNewPlan=false, retain=false 2023-07-24 17:07:45,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 17:07:46,092 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:07:46,096 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=79a622516d52c590ba83ebf6084d20b1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,096 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=17829ebd838c81805e47c54d618e1f97, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,097 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218466096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218466096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218466096"}]},"ts":"1690218466096"} 2023-07-24 17:07:46,097 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218466096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218466096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218466096"}]},"ts":"1690218466096"} 2023-07-24 17:07:46,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 79a622516d52c590ba83ebf6084d20b1, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:07:46,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 17829ebd838c81805e47c54d618e1f97, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:07:46,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 17:07:46,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:46,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:46,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79a622516d52c590ba83ebf6084d20b1, NAME => 'testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:07:46,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17829ebd838c81805e47c54d618e1f97, NAME => 'testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:07:46,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. service=AccessControlService 2023-07-24 17:07:46,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. service=AccessControlService 2023-07-24 17:07:46,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:07:46,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:07:46,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:07:46,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 17829ebd838c81805e47c54d618e1f97 2023-07-24 17:07:46,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:07:46,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:07:46,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:07:46,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 17829ebd838c81805e47c54d618e1f97 2023-07-24 17:07:46,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:07:46,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 17829ebd838c81805e47c54d618e1f97 2023-07-24 17:07:46,263 INFO [StoreOpener-79a622516d52c590ba83ebf6084d20b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:07:46,263 INFO [StoreOpener-17829ebd838c81805e47c54d618e1f97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 17829ebd838c81805e47c54d618e1f97 2023-07-24 17:07:46,268 DEBUG [StoreOpener-79a622516d52c590ba83ebf6084d20b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/cf 2023-07-24 17:07:46,268 DEBUG [StoreOpener-79a622516d52c590ba83ebf6084d20b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/cf 2023-07-24 17:07:46,269 DEBUG [StoreOpener-17829ebd838c81805e47c54d618e1f97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/cf 2023-07-24 17:07:46,269 DEBUG [StoreOpener-17829ebd838c81805e47c54d618e1f97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/cf 2023-07-24 17:07:46,269 INFO [StoreOpener-79a622516d52c590ba83ebf6084d20b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79a622516d52c590ba83ebf6084d20b1 columnFamilyName cf 2023-07-24 17:07:46,269 INFO [StoreOpener-17829ebd838c81805e47c54d618e1f97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17829ebd838c81805e47c54d618e1f97 columnFamilyName cf 2023-07-24 17:07:46,270 INFO [StoreOpener-79a622516d52c590ba83ebf6084d20b1-1] regionserver.HStore(310): Store=79a622516d52c590ba83ebf6084d20b1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:07:46,271 INFO [StoreOpener-17829ebd838c81805e47c54d618e1f97-1] regionserver.HStore(310): Store=17829ebd838c81805e47c54d618e1f97/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:07:46,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:07:46,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97 2023-07-24 17:07:46,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97 2023-07-24 17:07:46,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 17829ebd838c81805e47c54d618e1f97 2023-07-24 17:07:46,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:07:46,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 17829ebd838c81805e47c54d618e1f97; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69817266, jitterRate=0.04035833477973938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:07:46,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 17829ebd838c81805e47c54d618e1f97: 2023-07-24 17:07:46,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97., pid=46, masterSystemTime=1690218466255 2023-07-24 17:07:46,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:07:46,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:46,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:46,284 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=17829ebd838c81805e47c54d618e1f97, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,284 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218466284"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218466284"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218466284"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218466284"}]},"ts":"1690218466284"} 2023-07-24 17:07:46,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:07:46,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:07:46,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-24 17:07:46,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 17829ebd838c81805e47c54d618e1f97, server=jenkins-hbase4.apache.org,40941,1690218389929 in 183 msec 2023-07-24 17:07:46,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79a622516d52c590ba83ebf6084d20b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73750955, jitterRate=0.09897486865520477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:07:46,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79a622516d52c590ba83ebf6084d20b1: 2023-07-24 17:07:46,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1., pid=45, masterSystemTime=1690218466255 2023-07-24 17:07:46,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17829ebd838c81805e47c54d618e1f97, ASSIGN in 352 msec 2023-07-24 17:07:46,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:46,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:46,296 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=79a622516d52c590ba83ebf6084d20b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218466296"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218466296"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218466296"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218466296"}]},"ts":"1690218466296"} 2023-07-24 17:07:46,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-24 17:07:46,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 79a622516d52c590ba83ebf6084d20b1, server=jenkins-hbase4.apache.org,45037,1690218390043 in 198 msec 2023-07-24 17:07:46,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-24 17:07:46,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=79a622516d52c590ba83ebf6084d20b1, ASSIGN in 365 msec 2023-07-24 17:07:46,305 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:07:46,305 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218466305"}]},"ts":"1690218466305"} 2023-07-24 17:07:46,307 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 17:07:46,309 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:07:46,309 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 17:07:46,312 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 17:07:46,314 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:46,314 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:46,314 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:46,314 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:07:46,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 17:07:46,316 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:07:46,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 17:07:46,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 17:07:46,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 463 msec 2023-07-24 17:07:46,319 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 17:07:46,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 17:07:46,464 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 17:07:46,475 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 17:07:46,475 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:46,477 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:07:46,495 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218466495 (current time:1690218466495). 2023-07-24 17:07:46,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:07:46,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x37212547 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:07:46,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b28ceda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:07:46,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:07:46,509 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:07:46,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37212547 to 127.0.0.1:49485 2023-07-24 17:07:46,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:07:46,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x118b55e9 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:07:46,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f3e4182, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:07:46,525 DEBUG [hconnection-0x529d14a1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:07:46,528 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:07:46,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x118b55e9 to 127.0.0.1:49485 2023-07-24 17:07:46,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:07:46,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 17:07:46,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:07:46,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,539 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,540 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690219066540 2023-07-24 17:07:46,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 17:07:46,541 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:07:46,542 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:07:46,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,546 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,548 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-24 17:07:46,549 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,550 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690219066550 2023-07-24 17:07:46,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,564 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 17:07:46,564 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,565 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 17:07:46,565 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 17:07:46,566 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,566 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,567 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,567 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,567 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,567 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,568 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,568 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,568 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,568 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:07:46,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 17:07:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 17:07:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 17:07:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,569 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:46,569 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:46,569 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:46,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,570 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:46,571 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,571 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:46,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:46,573 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:46,578 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,578 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,583 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,583 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,583 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,584 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 17:07:46,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b655cbe[Count = 1] remaining members to acquire global barrier 2023-07-24 17:07:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 17:07:46,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b655cbe[Count = 0] remaining members to acquire global barrier 2023-07-24 17:07:46,589 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 17:07:46,589 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,591 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,591 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,591 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:46,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,591 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:46,591 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,591 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,592 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:07:46,594 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:07:46,597 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:46,597 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:46,597 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:07:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:07:46,639 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:07:46,609 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:46,639 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:46,640 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. started... 2023-07-24 17:07:46,640 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. started... 2023-07-24 17:07:46,639 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:07:46,640 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79a622516d52c590ba83ebf6084d20b1: 2023-07-24 17:07:46,640 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,640 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:07:46,640 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:07:46,642 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17829ebd838c81805e47c54d618e1f97: 2023-07-24 17:07:46,642 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,643 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:46,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:46,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:07:46,645 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:07:46,651 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:07:46,652 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:07:46,667 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. completed. 2023-07-24 17:07:46,667 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:46,667 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:07:46,667 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:07:46,667 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,667 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:46,667 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:07:46,669 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,669 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:46,669 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,669 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:07:46,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 17:07:46,687 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. completed. 2023-07-24 17:07:46,687 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:46,687 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:07:46,687 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:07:46,687 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,687 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:46,687 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:07:46,689 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,689 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,689 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:46,689 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:07:46,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 17:07:46,695 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 17:07:46,695 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:07:46,695 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:07:46,695 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,695 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:07:46,698 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,698 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:46,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,700 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,702 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,703 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:46,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,705 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,706 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,706 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,710 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,710 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:46,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 17:07:46,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:46,709 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:46,709 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:46,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:07:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,710 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,712 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:46,712 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:46,712 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,712 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 17:07:46,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:46,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:46,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 17:07:46,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,806 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 17:07:46,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690218466541Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690218466736 (+195 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690218466736Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690218466736Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690218466751 (+15 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690218466772 (+21 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690218466806 (+34 ms) 2023-07-24 17:07:46,809 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,811 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 267 msec 2023-07-24 17:07:46,845 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:46,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:46,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:07:46,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:07:46,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40941] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:07:46,868 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 17:07:46,869 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:46,869 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:07:46,883 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218466884 (current time:1690218466884). 2023-07-24 17:07:46,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:07:46,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x02fab557 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:07:46,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4833a525, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:07:46,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:07:46,915 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:07:46,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02fab557 to 127.0.0.1:49485 2023-07-24 17:07:46,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:07:46,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x637febb2 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:07:46,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34f8ba87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:07:46,933 DEBUG [hconnection-0x61b73bb0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:07:46,934 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:07:46,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x637febb2 to 127.0.0.1:49485 2023-07-24 17:07:46,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:07:46,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 17:07:46,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:07:46,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,953 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,963 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690219066963 2023-07-24 17:07:46,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 17:07:46,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 17:07:46,975 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 17:07:46,975 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:07:46,975 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:07:46,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 31 msec 2023-07-24 17:07:46,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,985 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:46,987 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690219066987 2023-07-24 17:07:47,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 17:07:47,034 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 17:07:47,034 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:47,036 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 17:07:47,036 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 17:07:47,037 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,037 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,038 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:47,038 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:47,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:47,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:47,039 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,038 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:47,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:47,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:47,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:47,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:47,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,040 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,041 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,041 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,041 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:07:47,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 17:07:47,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 17:07:47,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 17:07:47,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,042 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:47,042 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:47,042 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 17:07:47,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 17:07:47,043 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:47,043 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:47,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 17:07:47,045 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:47,045 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:47,045 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:47,045 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:47,045 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:47,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 17:07:47,047 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 17:07:47,047 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:07:47,052 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 17:07:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 17:07:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 17:07:47,054 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,054 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,055 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:47,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:47,056 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:47,057 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:07:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:47,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 17:07:47,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b3f0411[Count = 1] remaining members to acquire global barrier 2023-07-24 17:07:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:47,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 17:07:47,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b3f0411[Count = 0] remaining members to acquire global barrier 2023-07-24 17:07:47,066 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 17:07:47,066 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,068 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,068 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:47,068 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 17:07:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:07:47,069 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:07:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:07:47,069 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:47,070 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. started... 2023-07-24 17:07:47,070 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,070 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:07:47,070 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 79a622516d52c590ba83ebf6084d20b1 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 17:07:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:07:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:07:47,073 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:47,073 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. started... 2023-07-24 17:07:47,074 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 17829ebd838c81805e47c54d618e1f97 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 17:07:47,075 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:47,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:47,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:07:47,077 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:07:47,154 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724dc9cc8c910b941b5acba2faceb74824e to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724dc9cc8c910b941b5acba2faceb74824e 2023-07-24 17:07:47,174 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/.tmp/cf/4733c56442d44ca199684decc2aba1f2 2023-07-24 17:07:47,184 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/.tmp/cf/4733c56442d44ca199684decc2aba1f2 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/cf/4733c56442d44ca199684decc2aba1f2 2023-07-24 17:07:47,191 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/cf/4733c56442d44ca199684decc2aba1f2, entries=45, sequenceid=6, filesize=12.4 K 2023-07-24 17:07:47,192 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 17829ebd838c81805e47c54d618e1f97 in 118ms, sequenceid=6, compaction requested=false 2023-07-24 17:07:47,192 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 17:07:47,193 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17829ebd838c81805e47c54d618e1f97: 2023-07-24 17:07:47,193 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 17:07:47,193 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:07:47,194 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/cf/4733c56442d44ca199684decc2aba1f2] hfiles 2023-07-24 17:07:47,194 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/cf/4733c56442d44ca199684decc2aba1f2 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 17:07:47,201 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. completed. 2023-07-24 17:07:47,201 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:07:47,201 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:07:47,202 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:07:47,202 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,202 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:47,202 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:07:47,203 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,203 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:47,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:47,203 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:47,204 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:47,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:47,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:07:47,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 17:07:47,277 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:47,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:47,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:07:47,279 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:07:47,557 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724f8ffee1aa6aa4b5ea30431cd5406d365 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724f8ffee1aa6aa4b5ea30431cd5406d365 2023-07-24 17:07:47,581 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/.tmp/cf/00e676d4bd7f4a52bbd624b396368801 2023-07-24 17:07:47,586 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:47,587 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/.tmp/cf/00e676d4bd7f4a52bbd624b396368801 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/cf/00e676d4bd7f4a52bbd624b396368801 2023-07-24 17:07:47,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:47,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:07:47,588 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 17:07:47,594 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/cf/00e676d4bd7f4a52bbd624b396368801, entries=5, sequenceid=6, filesize=5.7 K 2023-07-24 17:07:47,595 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 79a622516d52c590ba83ebf6084d20b1 in 525ms, sequenceid=6, compaction requested=false 2023-07-24 17:07:47,596 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79a622516d52c590ba83ebf6084d20b1: 2023-07-24 17:07:47,597 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 17:07:47,597 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:07:47,597 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/cf/00e676d4bd7f4a52bbd624b396368801] hfiles 2023-07-24 17:07:47,597 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/cf/00e676d4bd7f4a52bbd624b396368801 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 17:07:47,629 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. completed. 2023-07-24 17:07:47,629 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:07:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:07:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:07:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 17:07:47,629 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:07:47,631 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 17:07:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:47,632 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 17:07:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:07:47,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 17:07:47,639 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 17:07:47,639 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:07:47,639 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:07:47,639 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 17:07:47,639 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:07:47,646 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,646 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,646 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,646 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,646 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:07:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:07:47,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,646 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,647 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,648 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:07:47,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,648 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,649 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:07:47,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,653 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:07:47,653 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 17:07:47,653 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:47,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:47,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:07:47,667 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,667 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:07:47,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 17:07:47,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:47,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 17:07:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:47,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:47,667 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:07:47,667 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:07:47,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:07:47,667 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 17:07:47,669 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:07:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:07:47,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,669 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:07:47,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:07:47,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,669 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,670 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:07:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:07:47,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724dc9cc8c910b941b5acba2faceb74824e, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724f8ffee1aa6aa4b5ea30431cd5406d365] mob files 2023-07-24 17:07:47,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724dc9cc8c910b941b5acba2faceb74824e 2023-07-24 17:07:47,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724f8ffee1aa6aa4b5ea30431cd5406d365 2023-07-24 17:07:47,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 17:07:47,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,761 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 17:07:47,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,762 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:47,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690218466965Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690218467679 (+714 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690218467679Loading Region manifests for snaptb0-testConsecutiveExports at 1690218467679Writing data manifest for snaptb0-testConsecutiveExports at 1690218467698 (+19 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690218467714 (+16 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690218467761 (+47 ms) 2023-07-24 17:07:47,765 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 17:07:47,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 792 msec 2023-07-24 17:07:48,088 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:07:48,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 17:07:48,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:07:48,089 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089 2023-07-24 17:07:48,089 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089, srcFsUri=hdfs://localhost:45525, srcDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:07:48,112 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:07:48,112 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7addafda, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:48,112 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26, snapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 17:07:48,122 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:07:48,136 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,136 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,136 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,137 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,137 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,137 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,138 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,206 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop-149030085500533436.jar 2023-07-24 17:07:48,207 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,207 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,207 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,208 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,208 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,208 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:07:48,209 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:07:48,209 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:07:48,210 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:07:48,210 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:07:48,210 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:07:48,211 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:07:48,211 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:07:48,211 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:07:48,212 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:07:48,212 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:07:48,213 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:48,213 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:48,213 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:48,214 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:48,214 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:07:48,215 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:48,215 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:07:48,647 WARN [Listener at jenkins-hbase4.apache.org/33193] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:07:48,649 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 17:07:48,652 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 17:07:50,047 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:07:50,047 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:07:50,051 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0002_000001 (auth:SIMPLE) 2023-07-24 17:07:50,611 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0003_000001 (auth:SIMPLE) 2023-07-24 17:07:51,154 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:07:57,463 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0003_000001 (auth:SIMPLE) 2023-07-24 17:07:59,840 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0003_000001 (auth:SIMPLE) 2023-07-24 17:08:03,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0003_000001 (auth:SIMPLE) 2023-07-24 17:08:04,904 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:08:04,905 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:08:04,924 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 17:08:04,924 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:08:04,925 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:08:04,926 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:08:04,926 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 17:08:04,926 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 17:08:04,926 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1253e9c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:08:04,927 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 17:08:04,927 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 17:08:04,928 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089, srcFsUri=hdfs://localhost:45525, srcDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:08:04,953 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:08:04,953 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6977da86, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:08:04,953 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26, snapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 17:08:04,975 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 17:08:05,016 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,017 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,017 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,018 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,018 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,019 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,019 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,112 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop-7280269974483105095.jar 2023-07-24 17:08:05,112 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,113 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,113 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,113 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,114 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,114 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:05,114 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:08:05,115 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:08:05,115 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:08:05,115 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:08:05,116 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:08:05,116 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:08:05,117 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:08:05,117 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:08:05,117 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:08:05,118 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:08:05,118 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:05,118 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:05,119 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:05,119 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:05,119 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:05,120 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:05,120 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:06,615 WARN [Listener at jenkins-hbase4.apache.org/33193] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:08:06,619 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 17:08:06,621 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 17:08:09,778 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:09,778 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:09,782 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0003_000001 (auth:SIMPLE) 2023-07-24 17:08:10,064 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:15,769 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:18,093 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:21,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:23,129 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:08:23,130 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:08:23,148 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 17:08:23,149 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:08:23,149 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:08:23,149 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:08:23,153 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 17:08:23,153 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 17:08:23,153 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1253e9c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 17:08:23,153 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 17:08:23,153 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/local-export-1690218468089/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 17:08:23,167 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 17:08:23,168 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 17:08:23,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:23,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 17:08:23,183 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218503183"}]},"ts":"1690218503183"} 2023-07-24 17:08:23,187 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 17:08:23,189 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 17:08:23,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=79a622516d52c590ba83ebf6084d20b1, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17829ebd838c81805e47c54d618e1f97, UNASSIGN}] 2023-07-24 17:08:23,197 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=79a622516d52c590ba83ebf6084d20b1, UNASSIGN 2023-07-24 17:08:23,197 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17829ebd838c81805e47c54d618e1f97, UNASSIGN 2023-07-24 17:08:23,201 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=79a622516d52c590ba83ebf6084d20b1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:23,201 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=17829ebd838c81805e47c54d618e1f97, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:23,201 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218503201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218503201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218503201"}]},"ts":"1690218503201"} 2023-07-24 17:08:23,201 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218503201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218503201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218503201"}]},"ts":"1690218503201"} 2023-07-24 17:08:23,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 79a622516d52c590ba83ebf6084d20b1, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:08:23,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 17829ebd838c81805e47c54d618e1f97, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:08:23,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 17:08:23,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:08:23,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 17829ebd838c81805e47c54d618e1f97 2023-07-24 17:08:23,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79a622516d52c590ba83ebf6084d20b1, disabling compactions & flushes 2023-07-24 17:08:23,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 17829ebd838c81805e47c54d618e1f97, disabling compactions & flushes 2023-07-24 17:08:23,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:08:23,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:08:23,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:08:23,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:08:23,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. after waiting 0 ms 2023-07-24 17:08:23,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:08:23,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. after waiting 0 ms 2023-07-24 17:08:23,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:08:23,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:23,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:23,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:23,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:23,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1. 2023-07-24 17:08:23,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79a622516d52c590ba83ebf6084d20b1: 2023-07-24 17:08:23,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97. 2023-07-24 17:08:23,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 17829ebd838c81805e47c54d618e1f97: 2023-07-24 17:08:23,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:08:23,384 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=79a622516d52c590ba83ebf6084d20b1, regionState=CLOSED 2023-07-24 17:08:23,384 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218503384"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218503384"}]},"ts":"1690218503384"} 2023-07-24 17:08:23,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 17829ebd838c81805e47c54d618e1f97 2023-07-24 17:08:23,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=17829ebd838c81805e47c54d618e1f97, regionState=CLOSED 2023-07-24 17:08:23,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690218503385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218503385"}]},"ts":"1690218503385"} 2023-07-24 17:08:23,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-24 17:08:23,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 79a622516d52c590ba83ebf6084d20b1, server=jenkins-hbase4.apache.org,45037,1690218390043 in 179 msec 2023-07-24 17:08:23,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-24 17:08:23,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 17829ebd838c81805e47c54d618e1f97, server=jenkins-hbase4.apache.org,40941,1690218389929 in 179 msec 2023-07-24 17:08:23,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=79a622516d52c590ba83ebf6084d20b1, UNASSIGN in 199 msec 2023-07-24 17:08:23,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-24 17:08:23,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17829ebd838c81805e47c54d618e1f97, UNASSIGN in 200 msec 2023-07-24 17:08:23,401 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218503401"}]},"ts":"1690218503401"} 2023-07-24 17:08:23,403 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 17:08:23,405 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 17:08:23,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 238 msec 2023-07-24 17:08:23,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 17:08:23,482 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 17:08:23,484 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 17:08:23,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:23,490 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:23,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 17:08:23,493 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:23,495 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 17:08:23,500 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:23,500 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:23,500 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:23,501 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:23,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 17:08:23,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 17:08:23,503 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:23,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-24 17:08:23,503 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:08:23,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-24 17:08:23,503 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:08:23,503 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:23,504 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:23,504 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:23,504 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 17:08:23,504 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:23,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 17:08:23,506 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:08:23,525 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/recovered.edits] 2023-07-24 17:08:23,530 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97 2023-07-24 17:08:23,533 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/cf/00e676d4bd7f4a52bbd624b396368801 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/cf/00e676d4bd7f4a52bbd624b396368801 2023-07-24 17:08:23,533 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/recovered.edits] 2023-07-24 17:08:23,537 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1/recovered.edits/9.seqid 2023-07-24 17:08:23,538 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/79a622516d52c590ba83ebf6084d20b1 2023-07-24 17:08:23,545 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/cf/4733c56442d44ca199684decc2aba1f2 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/cf/4733c56442d44ca199684decc2aba1f2 2023-07-24 17:08:23,550 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97/recovered.edits/9.seqid 2023-07-24 17:08:23,550 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testConsecutiveExports/17829ebd838c81805e47c54d618e1f97 2023-07-24 17:08:23,551 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 17:08:23,551 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 17:08:23,554 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-24 17:08:23,560 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724dc9cc8c910b941b5acba2faceb74824e to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724dc9cc8c910b941b5acba2faceb74824e 2023-07-24 17:08:23,562 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724f8ffee1aa6aa4b5ea30431cd5406d365 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724f8ffee1aa6aa4b5ea30431cd5406d365 2023-07-24 17:08:23,563 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 17:08:23,566 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:23,573 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 17:08:23,577 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 17:08:23,578 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:23,578 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 17:08:23,578 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218503578"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:23,578 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218503578"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:23,581 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:08:23,581 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 79a622516d52c590ba83ebf6084d20b1, NAME => 'testtb-testConsecutiveExports,,1690218465853.79a622516d52c590ba83ebf6084d20b1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 17829ebd838c81805e47c54d618e1f97, NAME => 'testtb-testConsecutiveExports,1,1690218465853.17829ebd838c81805e47c54d618e1f97.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:08:23,581 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 17:08:23,581 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218503581"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:23,583 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 17:08:23,587 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 17:08:23,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 103 msec 2023-07-24 17:08:23,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 17:08:23,607 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 17:08:23,629 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 17:08:23,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 17:08:23,642 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 17:08:23,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 17:08:23,678 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=737 (was 730) Potentially hanging thread: LogDeleter #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_958420901_1 at /127.0.0.1:34880 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:45349 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3190 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:43178 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:49948 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_958420901_1 at /127.0.0.1:49938 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:34922 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=887 (was 891), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=503 (was 151) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=4983 (was 5784) 2023-07-24 17:08:23,679 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=737 is superior to 500 2023-07-24 17:08:23,714 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=737, OpenFileDescriptor=887, MaxFileDescriptor=60000, SystemLoadAverage=503, ProcessCount=181, AvailableMemoryMB=4983 2023-07-24 17:08:23,714 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=737 is superior to 500 2023-07-24 17:08:23,717 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 17:08:23,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:23,726 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:08:23,727 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 17:08:23,728 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:08:23,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 17:08:23,733 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:23,737 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:23,738 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b empty. 2023-07-24 17:08:23,739 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd empty. 2023-07-24 17:08:23,740 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:23,740 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:23,743 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 17:08:23,801 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 17:08:23,805 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => d8e3457e5ded9807f57c4b9b6c08f05b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:08:23,807 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => edce114f0b38cb4dadfa59bd085eaebd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:08:23,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 17:08:23,869 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:23,869 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing d8e3457e5ded9807f57c4b9b6c08f05b, disabling compactions & flushes 2023-07-24 17:08:23,869 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:23,869 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:23,869 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. after waiting 0 ms 2023-07-24 17:08:23,869 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:23,869 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:23,869 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for d8e3457e5ded9807f57c4b9b6c08f05b: 2023-07-24 17:08:23,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:23,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing edce114f0b38cb4dadfa59bd085eaebd, disabling compactions & flushes 2023-07-24 17:08:23,881 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:23,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:23,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. after waiting 0 ms 2023-07-24 17:08:23,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:23,881 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:23,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for edce114f0b38cb4dadfa59bd085eaebd: 2023-07-24 17:08:23,885 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:08:23,887 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218503886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218503886"}]},"ts":"1690218503886"} 2023-07-24 17:08:23,887 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218503886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218503886"}]},"ts":"1690218503886"} 2023-07-24 17:08:23,902 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:08:23,903 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:08:23,904 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218503903"}]},"ts":"1690218503903"} 2023-07-24 17:08:23,905 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 17:08:23,911 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:08:23,913 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:08:23,914 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:08:23,914 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:08:23,914 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:08:23,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8e3457e5ded9807f57c4b9b6c08f05b, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edce114f0b38cb4dadfa59bd085eaebd, ASSIGN}] 2023-07-24 17:08:23,917 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8e3457e5ded9807f57c4b9b6c08f05b, ASSIGN 2023-07-24 17:08:23,918 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edce114f0b38cb4dadfa59bd085eaebd, ASSIGN 2023-07-24 17:08:23,923 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8e3457e5ded9807f57c4b9b6c08f05b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45037,1690218390043; forceNewPlan=false, retain=false 2023-07-24 17:08:23,924 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edce114f0b38cb4dadfa59bd085eaebd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40941,1690218389929; forceNewPlan=false, retain=false 2023-07-24 17:08:24,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 17:08:24,073 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:08:24,077 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d8e3457e5ded9807f57c4b9b6c08f05b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,077 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=edce114f0b38cb4dadfa59bd085eaebd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,077 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218504077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218504077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218504077"}]},"ts":"1690218504077"} 2023-07-24 17:08:24,077 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218504077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218504077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218504077"}]},"ts":"1690218504077"} 2023-07-24 17:08:24,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure d8e3457e5ded9807f57c4b9b6c08f05b, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:08:24,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure edce114f0b38cb4dadfa59bd085eaebd, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:08:24,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:24,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:24,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d8e3457e5ded9807f57c4b9b6c08f05b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:08:24,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => edce114f0b38cb4dadfa59bd085eaebd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. service=AccessControlService 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. service=AccessControlService 2023-07-24 17:08:24,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:24,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:24,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:24,240 INFO [StoreOpener-edce114f0b38cb4dadfa59bd085eaebd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:24,240 INFO [StoreOpener-d8e3457e5ded9807f57c4b9b6c08f05b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:24,243 DEBUG [StoreOpener-edce114f0b38cb4dadfa59bd085eaebd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/cf 2023-07-24 17:08:24,243 DEBUG [StoreOpener-edce114f0b38cb4dadfa59bd085eaebd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/cf 2023-07-24 17:08:24,244 DEBUG [StoreOpener-d8e3457e5ded9807f57c4b9b6c08f05b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/cf 2023-07-24 17:08:24,244 DEBUG [StoreOpener-d8e3457e5ded9807f57c4b9b6c08f05b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/cf 2023-07-24 17:08:24,245 INFO [StoreOpener-d8e3457e5ded9807f57c4b9b6c08f05b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8e3457e5ded9807f57c4b9b6c08f05b columnFamilyName cf 2023-07-24 17:08:24,245 INFO [StoreOpener-edce114f0b38cb4dadfa59bd085eaebd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region edce114f0b38cb4dadfa59bd085eaebd columnFamilyName cf 2023-07-24 17:08:24,247 INFO [StoreOpener-d8e3457e5ded9807f57c4b9b6c08f05b-1] regionserver.HStore(310): Store=d8e3457e5ded9807f57c4b9b6c08f05b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:24,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:24,248 INFO [StoreOpener-edce114f0b38cb4dadfa59bd085eaebd-1] regionserver.HStore(310): Store=edce114f0b38cb4dadfa59bd085eaebd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:24,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:24,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:24,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:24,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:24,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:24,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d8e3457e5ded9807f57c4b9b6c08f05b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69472708, jitterRate=0.03522402048110962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:24,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d8e3457e5ded9807f57c4b9b6c08f05b: 2023-07-24 17:08:24,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b., pid=60, masterSystemTime=1690218504234 2023-07-24 17:08:24,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:24,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:24,266 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d8e3457e5ded9807f57c4b9b6c08f05b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,267 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218504266"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218504266"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218504266"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218504266"}]},"ts":"1690218504266"} 2023-07-24 17:08:24,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:24,270 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-24 17:08:24,270 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure d8e3457e5ded9807f57c4b9b6c08f05b, server=jenkins-hbase4.apache.org,45037,1690218390043 in 187 msec 2023-07-24 17:08:24,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8e3457e5ded9807f57c4b9b6c08f05b, ASSIGN in 356 msec 2023-07-24 17:08:24,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:24,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened edce114f0b38cb4dadfa59bd085eaebd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66317691, jitterRate=-0.011789396405220032}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:24,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for edce114f0b38cb4dadfa59bd085eaebd: 2023-07-24 17:08:24,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd., pid=61, masterSystemTime=1690218504234 2023-07-24 17:08:24,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:24,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:24,278 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=edce114f0b38cb4dadfa59bd085eaebd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,278 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218504278"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218504278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218504278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218504278"}]},"ts":"1690218504278"} 2023-07-24 17:08:24,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-24 17:08:24,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure edce114f0b38cb4dadfa59bd085eaebd, server=jenkins-hbase4.apache.org,40941,1690218389929 in 198 msec 2023-07-24 17:08:24,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-24 17:08:24,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edce114f0b38cb4dadfa59bd085eaebd, ASSIGN in 368 msec 2023-07-24 17:08:24,286 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:08:24,286 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218504286"}]},"ts":"1690218504286"} 2023-07-24 17:08:24,288 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 17:08:24,292 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:08:24,293 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 17:08:24,295 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 17:08:24,297 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:24,297 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:24,297 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:24,298 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:24,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:24,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:24,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:24,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:24,303 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 582 msec 2023-07-24 17:08:24,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 17:08:24,339 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 17:08:24,353 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,354 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:24,356 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:24,397 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:24,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218504397 (current time:1690218504397). 2023-07-24 17:08:24,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:24,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x312431dd to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:24,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31665717, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:24,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:24,434 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:24,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x312431dd to 127.0.0.1:49485 2023-07-24 17:08:24,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:24,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x78febf8c to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:24,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68c4c397, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:24,461 DEBUG [hconnection-0x6b99ef77-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:24,465 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:24,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78febf8c to 127.0.0.1:49485 2023-07-24 17:08:24,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:24,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 17:08:24,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:24,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:24,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:24,486 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:24,487 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690219104487 2023-07-24 17:08:24,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:24,487 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,490 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:24,490 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:24,492 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:24,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:24,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 18 msec 2023-07-24 17:08:24,498 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:24,499 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690219104499 2023-07-24 17:08:24,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,532 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 17:08:24,532 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:24,534 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 17:08:24,534 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 17:08:24,534 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,534 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,537 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:24,537 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,537 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:24,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:24,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:24,538 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:24,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:24,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:24,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:24,539 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,539 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:24,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,542 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,542 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 17:08:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,543 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 17:08:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,543 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 17:08:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,543 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:24,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:24,549 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:24,548 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:24,552 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,552 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,552 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,552 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:24,552 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,552 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:24,552 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,553 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,553 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:24,553 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,553 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:24,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 17:08:24,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b40db4e[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:24,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 17:08:24,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b40db4e[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:24,557 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 17:08:24,557 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,558 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,558 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,559 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,559 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:24,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,559 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,559 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:24,559 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,559 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:24,559 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:24,559 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:24,559 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:24,559 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:08:24,559 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. started... 2023-07-24 17:08:24,559 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:24,559 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:24,559 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:24,561 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. started... 2023-07-24 17:08:24,561 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for edce114f0b38cb4dadfa59bd085eaebd: 2023-07-24 17:08:24,561 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,561 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:24,561 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d8e3457e5ded9807f57c4b9b6c08f05b: 2023-07-24 17:08:24,561 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,561 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:24,561 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,561 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:24,562 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:24,562 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:24,567 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:24,567 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:24,567 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:24,581 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. completed. 2023-07-24 17:08:24,581 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:24,581 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:24,581 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:24,581 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,581 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. completed. 2023-07-24 17:08:24,582 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:24,582 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:24,582 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:08:24,582 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:24,582 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:24,582 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,582 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:24,582 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:08:24,583 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:24,583 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,583 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:24,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,583 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:24,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:24,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:24,585 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:24,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:24,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:24,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:24,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:08:24,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 17:08:24,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:24,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:24,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:24,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:24,590 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:24,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:24,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:24,591 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:24,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:24,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:08:24,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 17:08:24,593 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 17:08:24,593 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:24,593 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:24,593 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,593 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:24,595 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,595 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:24,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:24,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,595 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:24,595 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,595 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,596 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:24,596 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,596 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:24,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:24,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:24,597 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:24,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:24,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:24,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,597 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:24,599 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,599 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,600 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,604 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:24,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:24,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,605 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:24,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:24,604 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:24,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:24,606 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:24,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:24,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:24,605 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:24,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:24,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:08:24,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:24,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:24,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:24,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:24,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:24,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:24,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:24,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 17:08:24,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 17:08:24,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,698 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690218504488Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690218504620 (+132 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690218504620Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690218504620Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690218504624 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690218504649 (+25 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690218504698 (+49 ms) 2023-07-24 17:08:24,702 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:24,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 212 msec 2023-07-24 17:08:24,792 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:24,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:24,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:24,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:24,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40941] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:24,800 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,800 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:24,800 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:24,811 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:24,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218504811 (current time:1690218504811). 2023-07-24 17:08:24,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:24,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x477ac50d to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:24,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f4d5185, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:24,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:24,825 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:24,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x477ac50d to 127.0.0.1:49485 2023-07-24 17:08:24,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:24,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x34129442 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:24,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25d17d60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:24,931 DEBUG [hconnection-0xb5c126-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:24,937 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:24,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34129442 to 127.0.0.1:49485 2023-07-24 17:08:24,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:24,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 17:08:24,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:24,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:24,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:24,957 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:24,958 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690219104958 2023-07-24 17:08:24,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 17:08:24,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,961 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:24,961 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:24,964 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 17:08:24,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:24,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-24 17:08:24,967 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:24,969 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690219104969 2023-07-24 17:08:24,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,993 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 17:08:24,993 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:24,995 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 17:08:24,995 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 17:08:24,996 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,996 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,998 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:24,998 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,998 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:24,998 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:24,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:24,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:24,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:24,998 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:24,998 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,999 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:24,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,999 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:24,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:24,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 17:08:24,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:25,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 17:08:25,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:25,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,000 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:25,000 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:25,000 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:25,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,002 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:25,002 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:25,000 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:25,002 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:25,003 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:25,003 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:25,003 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:25,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 17:08:25,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,004 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 17:08:25,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,004 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 17:08:25,004 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:25,005 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 17:08:25,005 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 17:08:25,005 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 17:08:25,005 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:25,006 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:25,006 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,006 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:25,007 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,007 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:25,008 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,008 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,008 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:25,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:25,009 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,009 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:25,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:25,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 17:08:25,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cb952f4[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:25,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:25,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:25,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:25,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:25,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:25,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 17:08:25,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cb952f4[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:25,013 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 17:08:25,013 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,014 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,014 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,014 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,014 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:25,015 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:25,015 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 17:08:25,015 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:25,015 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:25,015 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,015 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:25,015 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:25,015 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:25,015 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. started... 2023-07-24 17:08:25,015 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,015 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d8e3457e5ded9807f57c4b9b6c08f05b 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 17:08:25,015 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:25,015 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:25,015 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:25,016 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. started... 2023-07-24 17:08:25,016 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:08:25,017 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2745): Flushing edce114f0b38cb4dadfa59bd085eaebd 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 17:08:25,021 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:25,022 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:25,022 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:25,048 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072400c77848a26a4be79d15a60040c14946 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072400c77848a26a4be79d15a60040c14946 2023-07-24 17:08:25,051 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724c73798bd729045ea99c23bd6d3620e8c to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724c73798bd729045ea99c23bd6d3620e8c 2023-07-24 17:08:25,061 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:25,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:25,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:25,062 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:25,068 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/.tmp/cf/3c0c2f8924ed4b79b1643167b9fff33b 2023-07-24 17:08:25,071 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/.tmp/cf/397ffa21bf77454cba0f66a984bc96c6 2023-07-24 17:08:25,075 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/.tmp/cf/3c0c2f8924ed4b79b1643167b9fff33b as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/cf/3c0c2f8924ed4b79b1643167b9fff33b 2023-07-24 17:08:25,078 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/.tmp/cf/397ffa21bf77454cba0f66a984bc96c6 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/cf/397ffa21bf77454cba0f66a984bc96c6 2023-07-24 17:08:25,083 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/cf/3c0c2f8924ed4b79b1643167b9fff33b, entries=2, sequenceid=6, filesize=5.3 K 2023-07-24 17:08:25,084 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/cf/397ffa21bf77454cba0f66a984bc96c6, entries=48, sequenceid=6, filesize=13.7 K 2023-07-24 17:08:25,085 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d8e3457e5ded9807f57c4b9b6c08f05b in 70ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:25,085 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for edce114f0b38cb4dadfa59bd085eaebd in 68ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:25,085 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 17:08:25,086 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 17:08:25,089 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d8e3457e5ded9807f57c4b9b6c08f05b: 2023-07-24 17:08:25,089 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for edce114f0b38cb4dadfa59bd085eaebd: 2023-07-24 17:08:25,089 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,089 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,089 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:25,089 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:25,089 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/cf/3c0c2f8924ed4b79b1643167b9fff33b] hfiles 2023-07-24 17:08:25,089 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/cf/397ffa21bf77454cba0f66a984bc96c6] hfiles 2023-07-24 17:08:25,089 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/cf/3c0c2f8924ed4b79b1643167b9fff33b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,090 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/cf/397ffa21bf77454cba0f66a984bc96c6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,101 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. completed. 2023-07-24 17:08:25,102 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:08:25,103 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. completed. 2023-07-24 17:08:25,104 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,104 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 17:08:25,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:08:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:25,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:25,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:25,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:25,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,110 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,110 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 17:08:25,111 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:25,111 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 17:08:25,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:25,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:08:25,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 17:08:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:25,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:25,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:25,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:25,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:08:25,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 17:08:25,119 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 17:08:25,119 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:25,119 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:25,119 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,119 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:25,125 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,125 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:25,125 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,125 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,125 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:25,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:25,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:25,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:25,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:25,126 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:25,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,126 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:25,126 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:25,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:25,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,128 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:25,128 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:25,131 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,132 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,133 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:25,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:25,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:25,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,137 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:25,137 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:25,138 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,138 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:25,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,138 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:25,138 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,138 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:08:25,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:25,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:25,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:25,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:25,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:25,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:25,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724c73798bd729045ea99c23bd6d3620e8c, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072400c77848a26a4be79d15a60040c14946] mob files 2023-07-24 17:08:25,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724c73798bd729045ea99c23bd6d3620e8c 2023-07-24 17:08:25,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072400c77848a26a4be79d15a60040c14946 2023-07-24 17:08:25,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,237 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 17:08:25,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,238 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:25,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690218504958Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690218505162 (+204 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690218505162Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690218505163 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690218505172 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690218505185 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690218505237 (+52 ms) 2023-07-24 17:08:25,241 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 17:08:25,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 280 msec 2023-07-24 17:08:25,262 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:25,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 17:08:25,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:25,305 DEBUG [Listener at jenkins-hbase4.apache.org/33193] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:08:25,313 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:08:25,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40941] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 17:08:25,316 DEBUG [Listener at jenkins-hbase4.apache.org/33193] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:08:25,324 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:08:25,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42771] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 17:08:25,325 DEBUG [Listener at jenkins-hbase4.apache.org/33193] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:08:25,337 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:08:25,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 17:08:25,351 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 17:08:25,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:25,362 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:08:25,362 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 17:08:25,363 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:08:25,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 17:08:25,370 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:25,370 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92 empty. 2023-07-24 17:08:25,371 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:25,372 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:25,372 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02 empty. 2023-07-24 17:08:25,373 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:25,373 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 17:08:25,465 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 17:08:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 17:08:25,483 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => eed1036c18e63bc58314421d4fa2ae92, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:08:25,492 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 469c82762b5c1af8f70075ba6d720a02, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:08:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing eed1036c18e63bc58314421d4fa2ae92, disabling compactions & flushes 2023-07-24 17:08:25,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. after waiting 0 ms 2023-07-24 17:08:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:25,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for eed1036c18e63bc58314421d4fa2ae92: 2023-07-24 17:08:25,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 17:08:25,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:25,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 469c82762b5c1af8f70075ba6d720a02, disabling compactions & flushes 2023-07-24 17:08:25,951 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:25,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:25,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. after waiting 0 ms 2023-07-24 17:08:25,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:25,951 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:25,951 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 469c82762b5c1af8f70075ba6d720a02: 2023-07-24 17:08:25,957 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:08:25,958 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218505958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218505958"}]},"ts":"1690218505958"} 2023-07-24 17:08:25,958 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218505958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218505958"}]},"ts":"1690218505958"} 2023-07-24 17:08:25,961 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:08:25,962 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:08:25,962 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218505962"}]},"ts":"1690218505962"} 2023-07-24 17:08:25,964 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 17:08:25,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 17:08:25,970 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:08:25,971 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:08:25,971 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:08:25,971 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:08:25,971 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:08:25,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eed1036c18e63bc58314421d4fa2ae92, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=469c82762b5c1af8f70075ba6d720a02, ASSIGN}] 2023-07-24 17:08:25,975 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=469c82762b5c1af8f70075ba6d720a02, ASSIGN 2023-07-24 17:08:25,975 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eed1036c18e63bc58314421d4fa2ae92, ASSIGN 2023-07-24 17:08:25,976 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eed1036c18e63bc58314421d4fa2ae92, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42771,1690218390000; forceNewPlan=false, retain=false 2023-07-24 17:08:25,976 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=469c82762b5c1af8f70075ba6d720a02, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45037,1690218390043; forceNewPlan=false, retain=false 2023-07-24 17:08:26,126 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:08:26,130 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=eed1036c18e63bc58314421d4fa2ae92, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:26,130 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=469c82762b5c1af8f70075ba6d720a02, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:26,130 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218506130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218506130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218506130"}]},"ts":"1690218506130"} 2023-07-24 17:08:26,130 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218506130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218506130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218506130"}]},"ts":"1690218506130"} 2023-07-24 17:08:26,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure eed1036c18e63bc58314421d4fa2ae92, server=jenkins-hbase4.apache.org,42771,1690218390000}] 2023-07-24 17:08:26,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 469c82762b5c1af8f70075ba6d720a02, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:08:26,287 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:26,287 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 17:08:26,295 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 17:08:26,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:26,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 469c82762b5c1af8f70075ba6d720a02, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 17:08:26,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. service=AccessControlService 2023-07-24 17:08:26,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:26,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:26,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:26,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eed1036c18e63bc58314421d4fa2ae92, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 17:08:26,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. service=AccessControlService 2023-07-24 17:08:26,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:26,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:26,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:26,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:26,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:26,305 INFO [StoreOpener-469c82762b5c1af8f70075ba6d720a02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,306 INFO [StoreOpener-eed1036c18e63bc58314421d4fa2ae92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:26,308 DEBUG [StoreOpener-eed1036c18e63bc58314421d4fa2ae92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/cf 2023-07-24 17:08:26,308 DEBUG [StoreOpener-eed1036c18e63bc58314421d4fa2ae92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/cf 2023-07-24 17:08:26,311 INFO [StoreOpener-eed1036c18e63bc58314421d4fa2ae92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eed1036c18e63bc58314421d4fa2ae92 columnFamilyName cf 2023-07-24 17:08:26,313 INFO [StoreOpener-eed1036c18e63bc58314421d4fa2ae92-1] regionserver.HStore(310): Store=eed1036c18e63bc58314421d4fa2ae92/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:26,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:26,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:26,321 DEBUG [StoreOpener-469c82762b5c1af8f70075ba6d720a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/cf 2023-07-24 17:08:26,321 DEBUG [StoreOpener-469c82762b5c1af8f70075ba6d720a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/cf 2023-07-24 17:08:26,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:26,322 INFO [StoreOpener-469c82762b5c1af8f70075ba6d720a02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469c82762b5c1af8f70075ba6d720a02 columnFamilyName cf 2023-07-24 17:08:26,327 INFO [StoreOpener-469c82762b5c1af8f70075ba6d720a02-1] regionserver.HStore(310): Store=469c82762b5c1af8f70075ba6d720a02/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:26,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:26,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:26,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 469c82762b5c1af8f70075ba6d720a02; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66405413, jitterRate=-0.010482236742973328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:26,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 469c82762b5c1af8f70075ba6d720a02: 2023-07-24 17:08:26,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eed1036c18e63bc58314421d4fa2ae92; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62410985, jitterRate=-0.07000385224819183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:26,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eed1036c18e63bc58314421d4fa2ae92: 2023-07-24 17:08:26,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92., pid=69, masterSystemTime=1690218506287 2023-07-24 17:08:26,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02., pid=70, masterSystemTime=1690218506288 2023-07-24 17:08:26,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:26,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:26,352 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=469c82762b5c1af8f70075ba6d720a02, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:26,352 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218506352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218506352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218506352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218506352"}]},"ts":"1690218506352"} 2023-07-24 17:08:26,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:26,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:26,354 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=eed1036c18e63bc58314421d4fa2ae92, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:26,354 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218506354"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218506354"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218506354"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218506354"}]},"ts":"1690218506354"} 2023-07-24 17:08:26,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-24 17:08:26,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 469c82762b5c1af8f70075ba6d720a02, server=jenkins-hbase4.apache.org,45037,1690218390043 in 220 msec 2023-07-24 17:08:26,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-24 17:08:26,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure eed1036c18e63bc58314421d4fa2ae92, server=jenkins-hbase4.apache.org,42771,1690218390000 in 225 msec 2023-07-24 17:08:26,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=469c82762b5c1af8f70075ba6d720a02, ASSIGN in 388 msec 2023-07-24 17:08:26,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-24 17:08:26,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eed1036c18e63bc58314421d4fa2ae92, ASSIGN in 388 msec 2023-07-24 17:08:26,367 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:08:26,367 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218506367"}]},"ts":"1690218506367"} 2023-07-24 17:08:26,371 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 17:08:26,375 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:08:26,376 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 17:08:26,378 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 17:08:26,380 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:26,380 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:26,380 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:26,380 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:26,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:26,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 1.0320 sec 2023-07-24 17:08:26,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 17:08:26,471 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 17:08:26,477 DEBUG [Listener at jenkins-hbase4.apache.org/33193] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:26,481 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:26,512 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions eed1036c18e63bc58314421d4fa2ae92, 469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[eed1036c18e63bc58314421d4fa2ae92, 469c82762b5c1af8f70075ba6d720a02], force=true 2023-07-24 17:08:26,529 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[eed1036c18e63bc58314421d4fa2ae92, 469c82762b5c1af8f70075ba6d720a02], force=true 2023-07-24 17:08:26,529 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[eed1036c18e63bc58314421d4fa2ae92, 469c82762b5c1af8f70075ba6d720a02], force=true 2023-07-24 17:08:26,530 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[eed1036c18e63bc58314421d4fa2ae92, 469c82762b5c1af8f70075ba6d720a02], force=true 2023-07-24 17:08:26,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:26,568 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39283] assignment.AssignmentManager(1299): Reporting jenkins-hbase4.apache.org,45037,1690218390043 state does not match state=MERGING, location=jenkins-hbase4.apache.org,45037,1690218390043, table=testtb-testExportFileSystemStateWithMergeRegion-1, region=469c82762b5c1af8f70075ba6d720a02 (time since last update=1690218506563ms) 2023-07-24 17:08:26,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eed1036c18e63bc58314421d4fa2ae92, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=469c82762b5c1af8f70075ba6d720a02, UNASSIGN}] 2023-07-24 17:08:26,571 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eed1036c18e63bc58314421d4fa2ae92, UNASSIGN 2023-07-24 17:08:26,572 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=469c82762b5c1af8f70075ba6d720a02, UNASSIGN 2023-07-24 17:08:26,573 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=eed1036c18e63bc58314421d4fa2ae92, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:26,573 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=469c82762b5c1af8f70075ba6d720a02, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:26,573 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218506573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218506573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218506573"}]},"ts":"1690218506573"} 2023-07-24 17:08:26,574 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218506573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218506573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218506573"}]},"ts":"1690218506573"} 2023-07-24 17:08:26,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure eed1036c18e63bc58314421d4fa2ae92, server=jenkins-hbase4.apache.org,42771,1690218390000}] 2023-07-24 17:08:26,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 469c82762b5c1af8f70075ba6d720a02, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:08:26,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:26,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 469c82762b5c1af8f70075ba6d720a02, disabling compactions & flushes 2023-07-24 17:08:26,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:26,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:26,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. after waiting 0 ms 2023-07-24 17:08:26,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:26,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:26,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 469c82762b5c1af8f70075ba6d720a02 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 17:08:26,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eed1036c18e63bc58314421d4fa2ae92, disabling compactions & flushes 2023-07-24 17:08:26,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:26,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:26,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. after waiting 0 ms 2023-07-24 17:08:26,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:26,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing eed1036c18e63bc58314421d4fa2ae92 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 17:08:26,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/.tmp/cf/108f6c92fed64282867480440373d4c1 2023-07-24 17:08:26,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/.tmp/cf/055144c0344d41f582b130eeea3abe74 2023-07-24 17:08:26,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/.tmp/cf/055144c0344d41f582b130eeea3abe74 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/cf/055144c0344d41f582b130eeea3abe74 2023-07-24 17:08:26,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/.tmp/cf/108f6c92fed64282867480440373d4c1 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/cf/108f6c92fed64282867480440373d4c1 2023-07-24 17:08:26,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/cf/055144c0344d41f582b130eeea3abe74, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 17:08:26,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 469c82762b5c1af8f70075ba6d720a02 in 73ms, sequenceid=5, compaction requested=false 2023-07-24 17:08:26,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 17:08:26,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/cf/108f6c92fed64282867480440373d4c1, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 17:08:26,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for eed1036c18e63bc58314421d4fa2ae92 in 73ms, sequenceid=5, compaction requested=false 2023-07-24 17:08:26,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 17:08:26,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:26,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92. 2023-07-24 17:08:26,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eed1036c18e63bc58314421d4fa2ae92: 2023-07-24 17:08:26,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 17:08:26,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:26,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02. 2023-07-24 17:08:26,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 469c82762b5c1af8f70075ba6d720a02: 2023-07-24 17:08:26,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:26,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:26,836 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=eed1036c18e63bc58314421d4fa2ae92, regionState=CLOSED 2023-07-24 17:08:26,836 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218506836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218506836"}]},"ts":"1690218506836"} 2023-07-24 17:08:26,837 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=469c82762b5c1af8f70075ba6d720a02, regionState=CLOSED 2023-07-24 17:08:26,837 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690218506837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218506837"}]},"ts":"1690218506837"} 2023-07-24 17:08:26,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-24 17:08:26,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure eed1036c18e63bc58314421d4fa2ae92, server=jenkins-hbase4.apache.org,42771,1690218390000 in 262 msec 2023-07-24 17:08:26,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-24 17:08:26,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eed1036c18e63bc58314421d4fa2ae92, UNASSIGN in 278 msec 2023-07-24 17:08:26,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 469c82762b5c1af8f70075ba6d720a02, server=jenkins-hbase4.apache.org,45037,1690218390043 in 262 msec 2023-07-24 17:08:26,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-24 17:08:26,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=469c82762b5c1af8f70075ba6d720a02, UNASSIGN in 275 msec 2023-07-24 17:08:26,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:26,909 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 17:08:26,912 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505350.eed1036c18e63bc58314421d4fa2ae92.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:26,912 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690218505350.469c82762b5c1af8f70075ba6d720a02.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:26,912 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:26,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccb6a6baf8009af51024462167ec3394, ASSIGN}] 2023-07-24 17:08:26,969 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccb6a6baf8009af51024462167ec3394, ASSIGN 2023-07-24 17:08:26,970 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccb6a6baf8009af51024462167ec3394, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42771,1690218390000; forceNewPlan=false, retain=false 2023-07-24 17:08:27,120 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 17:08:27,122 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ccb6a6baf8009af51024462167ec3394, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,122 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690218507122"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218507122"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218507122"}]},"ts":"1690218507122"} 2023-07-24 17:08:27,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure ccb6a6baf8009af51024462167ec3394, server=jenkins-hbase4.apache.org,42771,1690218390000}] 2023-07-24 17:08:27,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:27,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. 2023-07-24 17:08:27,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ccb6a6baf8009af51024462167ec3394, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.', STARTKEY => '', ENDKEY => ''} 2023-07-24 17:08:27,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. service=AccessControlService 2023-07-24 17:08:27,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:27,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:27,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:27,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:27,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:27,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/.regioninfo 2023-07-24 17:08:27,327 INFO [StoreOpener-ccb6a6baf8009af51024462167ec3394-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:27,328 DEBUG [StoreOpener-ccb6a6baf8009af51024462167ec3394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf 2023-07-24 17:08:27,329 DEBUG [StoreOpener-ccb6a6baf8009af51024462167ec3394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf 2023-07-24 17:08:27,329 INFO [StoreOpener-ccb6a6baf8009af51024462167ec3394-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccb6a6baf8009af51024462167ec3394 columnFamilyName cf 2023-07-24 17:08:27,361 DEBUG [StoreOpener-ccb6a6baf8009af51024462167ec3394-1] regionserver.HStore(539): loaded hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/055144c0344d41f582b130eeea3abe74.469c82762b5c1af8f70075ba6d720a02->hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/cf/055144c0344d41f582b130eeea3abe74-top 2023-07-24 17:08:27,367 DEBUG [StoreOpener-ccb6a6baf8009af51024462167ec3394-1] regionserver.HStore(539): loaded hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/108f6c92fed64282867480440373d4c1.eed1036c18e63bc58314421d4fa2ae92->hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/cf/108f6c92fed64282867480440373d4c1-top 2023-07-24 17:08:27,368 INFO [StoreOpener-ccb6a6baf8009af51024462167ec3394-1] regionserver.HStore(310): Store=ccb6a6baf8009af51024462167ec3394/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:27,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:27,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:27,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:27,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ccb6a6baf8009af51024462167ec3394; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69225964, jitterRate=0.03154724836349487}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:27,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ccb6a6baf8009af51024462167ec3394: 2023-07-24 17:08:27,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394., pid=77, masterSystemTime=1690218507276 2023-07-24 17:08:27,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.,because compaction is disabled. 2023-07-24 17:08:27,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. 2023-07-24 17:08:27,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. 2023-07-24 17:08:27,378 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ccb6a6baf8009af51024462167ec3394, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,378 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690218507378"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218507378"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218507378"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218507378"}]},"ts":"1690218507378"} 2023-07-24 17:08:27,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 17:08:27,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure ccb6a6baf8009af51024462167ec3394, server=jenkins-hbase4.apache.org,42771,1690218390000 in 256 msec 2023-07-24 17:08:27,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 17:08:27,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccb6a6baf8009af51024462167ec3394, ASSIGN in 415 msec 2023-07-24 17:08:27,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[eed1036c18e63bc58314421d4fa2ae92, 469c82762b5c1af8f70075ba6d720a02], force=true in 867 msec 2023-07-24 17:08:27,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 17:08:27,657 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 17:08:27,658 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 17:08:27,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218507658 (current time:1690218507658). 2023-07-24 17:08:27,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:27,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x39b2b5d7 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:27,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a9a1621, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:27,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:27,678 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:27,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39b2b5d7 to 127.0.0.1:49485 2023-07-24 17:08:27,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:27,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x7642673f to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:27,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a72782d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:27,693 DEBUG [hconnection-0x1013465c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:27,697 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:27,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7642673f to 127.0.0.1:49485 2023-07-24 17:08:27,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:27,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 17:08:27,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:27,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 17:08:27,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 17:08:27,712 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 17:08:27,713 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690219107713 2023-07-24 17:08:27,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 17:08:27,718 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:27,718 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:27,719 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 17:08:27,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 17:08:27,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-24 17:08:27,724 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 17:08:27,725 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690219107725 2023-07-24 17:08:27,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,741 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 17:08:27,741 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:27,743 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 17:08:27,743 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 17:08:27,811 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,811 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,813 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,813 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,814 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,815 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,815 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:27,816 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 17:08:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 17:08:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 17:08:27,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 17:08:27,818 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 17:08:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 17:08:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,820 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 17:08:27,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:27,820 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:27,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,823 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 17:08:27,823 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 17:08:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 17:08:27,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 17:08:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 17:08:27,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:27,827 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 17:08:27,829 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 17:08:27,829 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 17:08:27,829 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 17:08:27,829 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:27,831 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 17:08:27,831 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 17:08:27,831 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 17:08:27,833 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,835 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,835 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:27,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:27,835 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,835 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,835 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:27,835 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,835 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:27,836 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,836 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:27,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:27,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 17:08:27,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d986b71[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:27,839 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 17:08:27,839 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,841 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,841 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 17:08:27,841 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 17:08:27,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:08:27,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,842 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 17:08:27,842 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 17:08:27,842 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:08:27,842 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 17:08:27,842 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:27,843 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:27,843 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. 2023-07-24 17:08:27,843 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. started... 2023-07-24 17:08:27,846 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ccb6a6baf8009af51024462167ec3394: 2023-07-24 17:08:27,846 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,846 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:27,846 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 17:08:27,846 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:27,846 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 17:08:27,847 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:27,847 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 17:08:27,846 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 17:08:27,846 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,854 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:27,855 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/055144c0344d41f582b130eeea3abe74.469c82762b5c1af8f70075ba6d720a02->hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/cf/055144c0344d41f582b130eeea3abe74-top, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/108f6c92fed64282867480440373d4c1.eed1036c18e63bc58314421d4fa2ae92->hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/cf/108f6c92fed64282867480440373d4c1-top] hfiles 2023-07-24 17:08:27,855 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/055144c0344d41f582b130eeea3abe74.469c82762b5c1af8f70075ba6d720a02 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,856 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/108f6c92fed64282867480440373d4c1.eed1036c18e63bc58314421d4fa2ae92 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,903 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. completed. 2023-07-24 17:08:27,903 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. 2023-07-24 17:08:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 17:08:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:08:27,909 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 17:08:27,909 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:27,909 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,909 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 17:08:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,42771,1690218390000': 2023-07-24 17:08:27,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 17:08:27,915 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 17:08:27,915 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:27,915 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:27,915 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,915 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:27,917 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,917 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:27,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,919 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:27,920 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,921 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:27,917 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,918 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,918 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,923 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:27,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,923 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:27,926 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:27,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,933 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:27,933 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:27,938 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:27,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,939 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:27,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:27,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:27,939 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,940 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,940 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:27,940 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:27,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:27,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,940 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:27,940 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,940 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:27,940 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:27,940 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,940 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:27,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:27,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:27,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0004_000001 (auth:SIMPLE) 2023-07-24 17:08:28,020 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:28,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 17:08:28,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:28,022 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:08:28,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:28,133 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 17:08:28,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:28,133 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:28,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690218507713Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690218507939 (+226 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690218507942 (+3 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690218507957 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690218508026 (+69 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690218508133 (+107 ms) 2023-07-24 17:08:28,136 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 17:08:28,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 419 msec 2023-07-24 17:08:28,323 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:28,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 17:08:28,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:28,324 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324 2023-07-24 17:08:28,324 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45525, tgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324, rawTgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324, srcFsUri=hdfs://localhost:45525, srcDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:08:28,349 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:08:28,350 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1725889934_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:28,350 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26, snapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 17:08:28,362 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:28,399 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,400 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,400 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,400 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,401 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,401 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,401 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,481 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop-7897085342706591092.jar 2023-07-24 17:08:28,482 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,482 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,483 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,483 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,483 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,484 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:28,484 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:08:28,484 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:08:28,485 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:08:28,485 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:08:28,486 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:08:28,486 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:08:28,486 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:08:28,487 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:08:28,487 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:08:28,487 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:08:28,488 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:28,488 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:28,489 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:28,489 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:28,489 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:28,489 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:28,490 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:28,976 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:08:29,352 WARN [Listener at jenkins-hbase4.apache.org/33193] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:08:29,355 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 17:08:29,357 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 17:08:29,437 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:29,437 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:29,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:35,431 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:37,725 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:41,320 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:42,689 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:08:42,703 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:08:42,713 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:42,713 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:08:42,713 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:08:42,713 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:42,714 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 17:08:42,714 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 17:08:42,714 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:42,715 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 17:08:42,715 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218508324/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 17:08:42,722 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:42,723 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:42,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:42,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 17:08:42,728 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218522728"}]},"ts":"1690218522728"} 2023-07-24 17:08:42,729 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 17:08:42,737 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 17:08:42,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccb6a6baf8009af51024462167ec3394, UNASSIGN}] 2023-07-24 17:08:42,743 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccb6a6baf8009af51024462167ec3394, UNASSIGN 2023-07-24 17:08:42,744 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ccb6a6baf8009af51024462167ec3394, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:42,745 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690218522744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218522744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218522744"}]},"ts":"1690218522744"} 2023-07-24 17:08:42,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure ccb6a6baf8009af51024462167ec3394, server=jenkins-hbase4.apache.org,42771,1690218390000}] 2023-07-24 17:08:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 17:08:42,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:42,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ccb6a6baf8009af51024462167ec3394, disabling compactions & flushes 2023-07-24 17:08:42,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. 2023-07-24 17:08:42,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. 2023-07-24 17:08:42,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. after waiting 0 ms 2023-07-24 17:08:42,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. 2023-07-24 17:08:42,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 17:08:42,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:42,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394. 2023-07-24 17:08:42,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ccb6a6baf8009af51024462167ec3394: 2023-07-24 17:08:42,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:42,925 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ccb6a6baf8009af51024462167ec3394, regionState=CLOSED 2023-07-24 17:08:42,925 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690218522925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218522925"}]},"ts":"1690218522925"} 2023-07-24 17:08:42,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 17:08:42,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure ccb6a6baf8009af51024462167ec3394, server=jenkins-hbase4.apache.org,42771,1690218390000 in 184 msec 2023-07-24 17:08:42,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 17:08:42,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccb6a6baf8009af51024462167ec3394, UNASSIGN in 194 msec 2023-07-24 17:08:42,938 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218522938"}]},"ts":"1690218522938"} 2023-07-24 17:08:42,949 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 17:08:42,960 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 17:08:42,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 246 msec 2023-07-24 17:08:43,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 17:08:43,031 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 17:08:43,032 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,062 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,064 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,067 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,070 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:43,082 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:43,083 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:43,088 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/recovered.edits] 2023-07-24 17:08:43,090 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/recovered.edits] 2023-07-24 17:08:43,093 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/recovered.edits] 2023-07-24 17:08:43,114 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,114 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,114 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,114 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 17:08:43,119 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/cf/055144c0344d41f582b130eeea3abe74 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/cf/055144c0344d41f582b130eeea3abe74 2023-07-24 17:08:43,120 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/055144c0344d41f582b130eeea3abe74.469c82762b5c1af8f70075ba6d720a02 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/055144c0344d41f582b130eeea3abe74.469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:43,121 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/cf/108f6c92fed64282867480440373d4c1 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/cf/108f6c92fed64282867480440373d4c1 2023-07-24 17:08:43,131 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,131 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:43,131 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-24 17:08:43,131 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:08:43,131 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-24 17:08:43,131 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:43,131 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:43,131 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:43,131 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:08:43,131 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-24 17:08:43,132 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:08:43,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 17:08:43,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:43,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:43,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:43,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:43,158 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/108f6c92fed64282867480440373d4c1.eed1036c18e63bc58314421d4fa2ae92 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/cf/108f6c92fed64282867480440373d4c1.eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:43,161 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/recovered.edits/8.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92/recovered.edits/8.seqid 2023-07-24 17:08:43,162 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eed1036c18e63bc58314421d4fa2ae92 2023-07-24 17:08:43,169 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/recovered.edits/8.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02/recovered.edits/8.seqid 2023-07-24 17:08:43,170 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/469c82762b5c1af8f70075ba6d720a02 2023-07-24 17:08:43,172 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/recovered.edits/12.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394/recovered.edits/12.seqid 2023-07-24 17:08:43,173 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccb6a6baf8009af51024462167ec3394 2023-07-24 17:08:43,173 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 17:08:43,176 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,188 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 17:08:43,195 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 17:08:43,199 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,199 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 17:08:43,200 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218523199"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:43,206 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 17:08:43,206 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ccb6a6baf8009af51024462167ec3394, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690218505351.ccb6a6baf8009af51024462167ec3394.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 17:08:43,206 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 17:08:43,206 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218523206"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:43,208 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 17:08:43,211 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 179 msec 2023-07-24 17:08:43,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 17:08:43,234 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 17:08:43,235 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,235 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 17:08:43,241 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218523241"}]},"ts":"1690218523241"} 2023-07-24 17:08:43,243 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 17:08:43,253 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 17:08:43,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8e3457e5ded9807f57c4b9b6c08f05b, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edce114f0b38cb4dadfa59bd085eaebd, UNASSIGN}] 2023-07-24 17:08:43,265 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8e3457e5ded9807f57c4b9b6c08f05b, UNASSIGN 2023-07-24 17:08:43,265 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edce114f0b38cb4dadfa59bd085eaebd, UNASSIGN 2023-07-24 17:08:43,268 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=edce114f0b38cb4dadfa59bd085eaebd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:43,268 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d8e3457e5ded9807f57c4b9b6c08f05b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:43,268 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218523268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218523268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218523268"}]},"ts":"1690218523268"} 2023-07-24 17:08:43,268 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218523268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218523268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218523268"}]},"ts":"1690218523268"} 2023-07-24 17:08:43,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure d8e3457e5ded9807f57c4b9b6c08f05b, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:08:43,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure edce114f0b38cb4dadfa59bd085eaebd, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:08:43,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 17:08:43,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:43,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:43,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d8e3457e5ded9807f57c4b9b6c08f05b, disabling compactions & flushes 2023-07-24 17:08:43,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:43,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:43,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. after waiting 0 ms 2023-07-24 17:08:43,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:43,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing edce114f0b38cb4dadfa59bd085eaebd, disabling compactions & flushes 2023-07-24 17:08:43,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:43,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:43,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. after waiting 0 ms 2023-07-24 17:08:43,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:43,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:43,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:43,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:43,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:43,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd. 2023-07-24 17:08:43,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for edce114f0b38cb4dadfa59bd085eaebd: 2023-07-24 17:08:43,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b. 2023-07-24 17:08:43,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d8e3457e5ded9807f57c4b9b6c08f05b: 2023-07-24 17:08:43,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:43,500 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=edce114f0b38cb4dadfa59bd085eaebd, regionState=CLOSED 2023-07-24 17:08:43,500 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218523500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218523500"}]},"ts":"1690218523500"} 2023-07-24 17:08:43,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:43,502 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d8e3457e5ded9807f57c4b9b6c08f05b, regionState=CLOSED 2023-07-24 17:08:43,503 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690218523502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218523502"}]},"ts":"1690218523502"} 2023-07-24 17:08:43,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-24 17:08:43,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure edce114f0b38cb4dadfa59bd085eaebd, server=jenkins-hbase4.apache.org,40941,1690218389929 in 225 msec 2023-07-24 17:08:43,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-24 17:08:43,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edce114f0b38cb4dadfa59bd085eaebd, UNASSIGN in 244 msec 2023-07-24 17:08:43,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure d8e3457e5ded9807f57c4b9b6c08f05b, server=jenkins-hbase4.apache.org,45037,1690218390043 in 228 msec 2023-07-24 17:08:43,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-24 17:08:43,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8e3457e5ded9807f57c4b9b6c08f05b, UNASSIGN in 245 msec 2023-07-24 17:08:43,515 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218523515"}]},"ts":"1690218523515"} 2023-07-24 17:08:43,517 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 17:08:43,518 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 17:08:43,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 284 msec 2023-07-24 17:08:43,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 17:08:43,544 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 17:08:43,545 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,550 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,552 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,553 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,557 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:43,557 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:43,561 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/recovered.edits] 2023-07-24 17:08:43,562 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/recovered.edits] 2023-07-24 17:08:43,563 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,563 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,564 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,564 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 17:08:43,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 17:08:43,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 17:08:43,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 17:08:43,568 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/cf/397ffa21bf77454cba0f66a984bc96c6 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/cf/397ffa21bf77454cba0f66a984bc96c6 2023-07-24 17:08:43,569 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/cf/3c0c2f8924ed4b79b1643167b9fff33b to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/cf/3c0c2f8924ed4b79b1643167b9fff33b 2023-07-24 17:08:43,571 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,571 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,571 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,571 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:43,571 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:43,571 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,571 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:43,571 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:43,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 17:08:43,574 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd/recovered.edits/9.seqid 2023-07-24 17:08:43,574 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b/recovered.edits/9.seqid 2023-07-24 17:08:43,575 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edce114f0b38cb4dadfa59bd085eaebd 2023-07-24 17:08:43,575 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8e3457e5ded9807f57c4b9b6c08f05b 2023-07-24 17:08:43,575 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 17:08:43,576 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 17:08:43,577 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-24 17:08:43,585 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724c73798bd729045ea99c23bd6d3620e8c to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724c73798bd729045ea99c23bd6d3620e8c 2023-07-24 17:08:43,586 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072400c77848a26a4be79d15a60040c14946 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072400c77848a26a4be79d15a60040c14946 2023-07-24 17:08:43,587 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 17:08:43,589 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,603 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 17:08:43,609 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 17:08:43,610 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,610 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 17:08:43,610 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218523610"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:43,611 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218523610"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:43,613 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:08:43,613 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d8e3457e5ded9807f57c4b9b6c08f05b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690218503717.d8e3457e5ded9807f57c4b9b6c08f05b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => edce114f0b38cb4dadfa59bd085eaebd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690218503717.edce114f0b38cb4dadfa59bd085eaebd.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:08:43,613 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 17:08:43,613 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218523613"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:43,616 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 17:08:43,618 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 72 msec 2023-07-24 17:08:43,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 17:08:43,674 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 17:08:43,689 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 17:08:43,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,701 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 17:08:43,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 17:08:43,707 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 17:08:43,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 17:08:43,763 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 737) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1482488606_1 at /127.0.0.1:47454 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3992 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:43343 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:51692 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:51694 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:44416 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1482488606_1 at /127.0.0.1:51682 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:47480 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 887) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=657 (was 503) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=4532 (was 4983) 2023-07-24 17:08:43,763 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-24 17:08:43,794 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=657, ProcessCount=186, AvailableMemoryMB=4529 2023-07-24 17:08:43,794 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-24 17:08:43,799 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 17:08:43,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:08:43,805 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:08:43,805 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 17:08:43,806 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:08:43,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 17:08:43,808 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:43,808 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:43,809 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b empty. 2023-07-24 17:08:43,809 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e empty. 2023-07-24 17:08:43,809 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:43,809 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:43,809 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 17:08:43,859 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 17:08:43,860 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 567f89c39ebe1ee74660552eab468f4e, NAME => 'testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:08:43,860 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 131380d79752cf2386a95c372d295b0b, NAME => 'testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:08:43,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:43,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 567f89c39ebe1ee74660552eab468f4e, disabling compactions & flushes 2023-07-24 17:08:43,907 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:43,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:43,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. after waiting 0 ms 2023-07-24 17:08:43,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:43,907 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:43,907 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 567f89c39ebe1ee74660552eab468f4e: 2023-07-24 17:08:43,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 17:08:44,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 17:08:44,329 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:44,330 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 131380d79752cf2386a95c372d295b0b, disabling compactions & flushes 2023-07-24 17:08:44,330 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:44,330 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:44,330 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. after waiting 0 ms 2023-07-24 17:08:44,330 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:44,330 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:44,330 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 131380d79752cf2386a95c372d295b0b: 2023-07-24 17:08:44,333 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:08:44,334 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218524333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218524333"}]},"ts":"1690218524333"} 2023-07-24 17:08:44,334 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218524333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218524333"}]},"ts":"1690218524333"} 2023-07-24 17:08:44,336 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:08:44,336 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:08:44,337 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218524336"}]},"ts":"1690218524336"} 2023-07-24 17:08:44,338 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 17:08:44,342 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:08:44,343 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:08:44,343 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:08:44,343 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:08:44,343 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:08:44,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=567f89c39ebe1ee74660552eab468f4e, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=131380d79752cf2386a95c372d295b0b, ASSIGN}] 2023-07-24 17:08:44,347 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=567f89c39ebe1ee74660552eab468f4e, ASSIGN 2023-07-24 17:08:44,347 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=131380d79752cf2386a95c372d295b0b, ASSIGN 2023-07-24 17:08:44,348 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=567f89c39ebe1ee74660552eab468f4e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40941,1690218389929; forceNewPlan=false, retain=false 2023-07-24 17:08:44,348 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=131380d79752cf2386a95c372d295b0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42771,1690218390000; forceNewPlan=false, retain=false 2023-07-24 17:08:44,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 17:08:44,498 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:08:44,501 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=131380d79752cf2386a95c372d295b0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:44,502 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=567f89c39ebe1ee74660552eab468f4e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:44,502 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218524501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218524501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218524501"}]},"ts":"1690218524501"} 2023-07-24 17:08:44,502 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218524502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218524502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218524502"}]},"ts":"1690218524502"} 2023-07-24 17:08:44,505 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 131380d79752cf2386a95c372d295b0b, server=jenkins-hbase4.apache.org,42771,1690218390000}] 2023-07-24 17:08:44,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 567f89c39ebe1ee74660552eab468f4e, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:08:44,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:44,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 567f89c39ebe1ee74660552eab468f4e, NAME => 'testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:08:44,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. service=AccessControlService 2023-07-24 17:08:44,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:44,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:44,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:44,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:44,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:44,671 INFO [StoreOpener-567f89c39ebe1ee74660552eab468f4e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:44,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:44,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 131380d79752cf2386a95c372d295b0b, NAME => 'testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:08:44,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. service=AccessControlService 2023-07-24 17:08:44,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:44,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:44,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:44,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:44,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:44,673 DEBUG [StoreOpener-567f89c39ebe1ee74660552eab468f4e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/cf 2023-07-24 17:08:44,673 DEBUG [StoreOpener-567f89c39ebe1ee74660552eab468f4e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/cf 2023-07-24 17:08:44,673 INFO [StoreOpener-567f89c39ebe1ee74660552eab468f4e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 567f89c39ebe1ee74660552eab468f4e columnFamilyName cf 2023-07-24 17:08:44,674 INFO [StoreOpener-131380d79752cf2386a95c372d295b0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:44,675 INFO [StoreOpener-567f89c39ebe1ee74660552eab468f4e-1] regionserver.HStore(310): Store=567f89c39ebe1ee74660552eab468f4e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:44,675 DEBUG [StoreOpener-131380d79752cf2386a95c372d295b0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/cf 2023-07-24 17:08:44,675 DEBUG [StoreOpener-131380d79752cf2386a95c372d295b0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/cf 2023-07-24 17:08:44,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:44,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:44,676 INFO [StoreOpener-131380d79752cf2386a95c372d295b0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 131380d79752cf2386a95c372d295b0b columnFamilyName cf 2023-07-24 17:08:44,677 INFO [StoreOpener-131380d79752cf2386a95c372d295b0b-1] regionserver.HStore(310): Store=131380d79752cf2386a95c372d295b0b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:44,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:44,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:44,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:44,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:44,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:44,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 567f89c39ebe1ee74660552eab468f4e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75483002, jitterRate=0.12478438019752502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:44,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 567f89c39ebe1ee74660552eab468f4e: 2023-07-24 17:08:44,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e., pid=94, masterSystemTime=1690218524658 2023-07-24 17:08:44,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:44,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:44,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:44,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 131380d79752cf2386a95c372d295b0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70621972, jitterRate=0.05234938859939575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:44,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 131380d79752cf2386a95c372d295b0b: 2023-07-24 17:08:44,698 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=567f89c39ebe1ee74660552eab468f4e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:44,698 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218524698"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218524698"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218524698"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218524698"}]},"ts":"1690218524698"} 2023-07-24 17:08:44,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b., pid=93, masterSystemTime=1690218524659 2023-07-24 17:08:44,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:44,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:44,707 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=131380d79752cf2386a95c372d295b0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:44,708 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218524707"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218524707"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218524707"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218524707"}]},"ts":"1690218524707"} 2023-07-24 17:08:44,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-24 17:08:44,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 567f89c39ebe1ee74660552eab468f4e, server=jenkins-hbase4.apache.org,40941,1690218389929 in 194 msec 2023-07-24 17:08:44,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=567f89c39ebe1ee74660552eab468f4e, ASSIGN in 366 msec 2023-07-24 17:08:44,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-24 17:08:44,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 131380d79752cf2386a95c372d295b0b, server=jenkins-hbase4.apache.org,42771,1690218390000 in 205 msec 2023-07-24 17:08:44,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-24 17:08:44,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=131380d79752cf2386a95c372d295b0b, ASSIGN in 371 msec 2023-07-24 17:08:44,717 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:08:44,718 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218524717"}]},"ts":"1690218524717"} 2023-07-24 17:08:44,719 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 17:08:44,727 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:08:44,728 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 17:08:44,729 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:08:44,732 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:44,732 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:44,732 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:44,734 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:44,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:44,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:44,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:44,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 936 msec 2023-07-24 17:08:44,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:44,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 17:08:44,913 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 17:08:44,916 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:44,917 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:44,918 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:44,932 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:44,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218524932 (current time:1690218524932). 2023-07-24 17:08:44,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:44,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x33af85c1 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:44,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fa62f3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:44,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:44,960 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:44,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33af85c1 to 127.0.0.1:49485 2023-07-24 17:08:44,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:44,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x4ffe8ced to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:44,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b0895e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:44,970 DEBUG [hconnection-0x2e4189bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:44,971 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:44,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ffe8ced to 127.0.0.1:49485 2023-07-24 17:08:44,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:44,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:08:44,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:44,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:44,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:44,988 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:44,995 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690219124994 2023-07-24 17:08:44,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:44,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:45,000 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:45,000 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:45,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:45,003 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:45,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 19 msec 2023-07-24 17:08:45,010 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:45,010 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690219125010 2023-07-24 17:08:45,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,054 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 17:08:45,054 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:45,056 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 17:08:45,056 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 17:08:45,057 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,057 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,062 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,063 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,063 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,063 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,063 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,064 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 17:08:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,065 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,065 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:45,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 17:08:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 17:08:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:45,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:45,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:45,071 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:45,071 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:45,071 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:45,071 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:45,072 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:45,072 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,074 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,075 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,076 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,076 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,076 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,076 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:45,078 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,079 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,083 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,083 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 17:08:45,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ed4f95f[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:45,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 17:08:45,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ed4f95f[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:45,088 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 17:08:45,089 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,090 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,091 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,091 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:45,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:08:45,091 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:45,091 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. started... 2023-07-24 17:08:45,093 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,093 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 567f89c39ebe1ee74660552eab468f4e: 2023-07-24 17:08:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:45,095 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:45,095 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. started... 2023-07-24 17:08:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:45,097 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 131380d79752cf2386a95c372d295b0b: 2023-07-24 17:08:45,097 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,097 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:45,097 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:45,100 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:45,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:45,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:45,102 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:45,139 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. completed. 2023-07-24 17:08:45,139 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:45,139 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. completed. 2023-07-24 17:08:45,139 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:08:45,141 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:45,141 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,141 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,141 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:45,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,143 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,143 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:45,143 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:45,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,143 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:45,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42771,1690218390000': 2023-07-24 17:08:45,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 17:08:45,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:08:45,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 17:08:45,152 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 17:08:45,153 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:45,153 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:45,153 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,153 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:45,155 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,155 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,155 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,155 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,155 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,156 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,157 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,159 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,159 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,160 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,163 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,163 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,163 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,163 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,163 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,163 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:45,163 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,163 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,163 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,165 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,163 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,163 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,167 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:08:45,165 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,167 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,168 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,168 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,168 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,168 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,168 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 17:08:45,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 17:08:45,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,219 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690218524995Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690218525176 (+181 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690218525176Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690218525176Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690218525179 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690218525191 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690218525219 (+28 ms) 2023-07-24 17:08:45,223 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:45,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 225 msec 2023-07-24 17:08:45,302 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:45,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:45,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:45,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40941] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:45,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42771] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:45,315 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:45,316 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:45,316 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:45,326 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:45,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218525326 (current time:1690218525326). 2023-07-24 17:08:45,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:45,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x18ef2280 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:45,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a417c77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:45,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:45,342 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:45,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18ef2280 to 127.0.0.1:49485 2023-07-24 17:08:45,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:45,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x128407a3 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:45,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731edc51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:45,354 DEBUG [hconnection-0x420db481-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:45,358 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:45,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x128407a3 to 127.0.0.1:49485 2023-07-24 17:08:45,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:45,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 17:08:45,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:45,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:45,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:45,368 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:45,368 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690219125368 2023-07-24 17:08:45,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 17:08:45,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:45,370 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:45,370 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:45,371 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 17:08:45,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:45,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-24 17:08:45,373 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:45,374 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690219125374 2023-07-24 17:08:45,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,388 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 17:08:45,388 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:45,390 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 17:08:45,390 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 17:08:45,390 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,391 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,392 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,392 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,392 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,392 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 17:08:45,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,394 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:45,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,394 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 17:08:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,394 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:45,394 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:45,395 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:45,396 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:45,396 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:45,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,396 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:45,396 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:45,397 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:45,397 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:45,397 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:45,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,397 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,398 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,399 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,399 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,399 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:45,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 17:08:45,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,400 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 17:08:45,400 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,400 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:45,401 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,401 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,401 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,401 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,403 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 17:08:45,403 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:45,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,406 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 17:08:45,407 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 17:08:45,407 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 17:08:45,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 17:08:45,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5343c360[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:45,408 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,408 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,409 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,409 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:45,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 17:08:45,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5343c360[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:45,411 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 17:08:45,411 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,421 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,421 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,421 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,421 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:45,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,422 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:45,422 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:08:45,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,422 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:45,422 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 17:08:45,422 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,422 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:45,422 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:45,422 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:45,422 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:45,422 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:45,422 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:45,422 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. started... 2023-07-24 17:08:45,422 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. started... 2023-07-24 17:08:45,423 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 131380d79752cf2386a95c372d295b0b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 17:08:45,423 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 567f89c39ebe1ee74660552eab468f4e 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 17:08:45,423 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:45,423 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:45,423 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:45,431 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,431 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:45,470 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:45,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:45,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:45,472 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:45,571 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307245cde8c4a05c441bcbfcbb2bf5dd5c2f5 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307245cde8c4a05c441bcbfcbb2bf5dd5c2f5 2023-07-24 17:08:45,573 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307248902816dc01f4a32ad1ed047c11dd605 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307248902816dc01f4a32ad1ed047c11dd605 2023-07-24 17:08:45,595 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/.tmp/cf/34ef0e9d5b7d4c9980a21a054c2ce98e 2023-07-24 17:08:45,595 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/.tmp/cf/c31eeacd157a496e86a8c8a6ddc9634e 2023-07-24 17:08:45,601 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/.tmp/cf/c31eeacd157a496e86a8c8a6ddc9634e as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/cf/c31eeacd157a496e86a8c8a6ddc9634e 2023-07-24 17:08:45,601 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/.tmp/cf/34ef0e9d5b7d4c9980a21a054c2ce98e as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/cf/34ef0e9d5b7d4c9980a21a054c2ce98e 2023-07-24 17:08:45,609 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/cf/34ef0e9d5b7d4c9980a21a054c2ce98e, entries=46, sequenceid=6, filesize=12.9 K 2023-07-24 17:08:45,610 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 131380d79752cf2386a95c372d295b0b in 187ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:45,610 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 17:08:45,610 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/cf/c31eeacd157a496e86a8c8a6ddc9634e, entries=4, sequenceid=6, filesize=5.6 K 2023-07-24 17:08:45,611 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 131380d79752cf2386a95c372d295b0b: 2023-07-24 17:08:45,611 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,613 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:45,613 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/cf/34ef0e9d5b7d4c9980a21a054c2ce98e] hfiles 2023-07-24 17:08:45,613 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/cf/34ef0e9d5b7d4c9980a21a054c2ce98e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,613 INFO [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 567f89c39ebe1ee74660552eab468f4e in 190ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:45,615 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 567f89c39ebe1ee74660552eab468f4e: 2023-07-24 17:08:45,615 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,615 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:45,615 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/cf/c31eeacd157a496e86a8c8a6ddc9634e] hfiles 2023-07-24 17:08:45,615 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/cf/c31eeacd157a496e86a8c8a6ddc9634e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,627 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. completed. 2023-07-24 17:08:45,627 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:45,627 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:45,627 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:45,627 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,627 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:45,627 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:08:45,629 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,629 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:45,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,629 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:45,629 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:45,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42771,1690218390000': 2023-07-24 17:08:45,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 17:08:45,643 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. completed. 2023-07-24 17:08:45,644 DEBUG [rs(jenkins-hbase4.apache.org,40941,1690218389929)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:45,644 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:45,644 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:45,644 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,644 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 17:08:45,644 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:08:45,646 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 17:08:45,646 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,646 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,646 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 17:08:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40941,1690218389929': 2023-07-24 17:08:45,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 17:08:45,652 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 17:08:45,652 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:45,652 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:45,652 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,652 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:45,655 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:45,655 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,656 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,655 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:45,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,656 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,657 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:45,659 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,659 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,660 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,662 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,662 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,662 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,663 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,663 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,663 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,663 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:45,663 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,663 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:45,663 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:45,663 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,663 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:45,663 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:45,663 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:45,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,665 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:45,665 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:45,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:45,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:45,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:08:45,666 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307245cde8c4a05c441bcbfcbb2bf5dd5c2f5, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307248902816dc01f4a32ad1ed047c11dd605] mob files 2023-07-24 17:08:45,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307245cde8c4a05c441bcbfcbb2bf5dd5c2f5 2023-07-24 17:08:45,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307248902816dc01f4a32ad1ed047c11dd605 2023-07-24 17:08:45,672 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:45,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:45,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:45,673 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 17:08:45,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,746 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 17:08:45,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,747 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:45,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690218525369Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690218525675 (+306 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690218525675Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690218525675Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690218525679 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690218525694 (+15 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690218525746 (+52 ms) 2023-07-24 17:08:45,750 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 17:08:45,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 380 msec 2023-07-24 17:08:45,973 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:45,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 17:08:45,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:45,975 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975 2023-07-24 17:08:45,975 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45525, tgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975, rawTgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975, srcFsUri=hdfs://localhost:45525, srcDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:08:46,008 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:08:46,008 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1698435487_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:46,008 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26, snapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 17:08:46,028 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:46,058 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,058 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,059 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,059 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,059 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,059 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,060 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,140 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop-8665836267160165928.jar 2023-07-24 17:08:46,140 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,140 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,141 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,141 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,141 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,141 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:46,142 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:08:46,142 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:08:46,143 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:08:46,143 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:08:46,143 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:08:46,144 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:08:46,144 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:08:46,145 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:08:46,145 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:08:46,145 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:08:46,146 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:46,146 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:46,146 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:46,146 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:46,147 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:46,147 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:46,147 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:47,495 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0005_000001 (auth:SIMPLE) 2023-07-24 17:08:47,498 WARN [Listener at jenkins-hbase4.apache.org/33193] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:08:47,504 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 17:08:47,637 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:47,637 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:08:47,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0006_000001 (auth:SIMPLE) 2023-07-24 17:08:48,546 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:08:54,005 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0006_000001 (auth:SIMPLE) 2023-07-24 17:08:57,012 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:08:57,013 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:08:57,033 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:57,033 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:08:57,034 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:08:57,034 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:57,035 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 17:08:57,035 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 17:08:57,035 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:57,036 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 17:08:57,036 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218525975/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 17:08:57,074 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,074 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,079 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218537079"}]},"ts":"1690218537079"} 2023-07-24 17:08:57,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 17:08:57,083 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 17:08:57,085 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 17:08:57,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=567f89c39ebe1ee74660552eab468f4e, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=131380d79752cf2386a95c372d295b0b, UNASSIGN}] 2023-07-24 17:08:57,091 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=131380d79752cf2386a95c372d295b0b, UNASSIGN 2023-07-24 17:08:57,091 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=567f89c39ebe1ee74660552eab468f4e, UNASSIGN 2023-07-24 17:08:57,092 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=131380d79752cf2386a95c372d295b0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:57,092 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=567f89c39ebe1ee74660552eab468f4e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:57,092 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218537092"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218537092"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218537092"}]},"ts":"1690218537092"} 2023-07-24 17:08:57,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218537092"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218537092"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218537092"}]},"ts":"1690218537092"} 2023-07-24 17:08:57,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 131380d79752cf2386a95c372d295b0b, server=jenkins-hbase4.apache.org,42771,1690218390000}] 2023-07-24 17:08:57,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 567f89c39ebe1ee74660552eab468f4e, server=jenkins-hbase4.apache.org,40941,1690218389929}] 2023-07-24 17:08:57,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 17:08:57,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:57,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 131380d79752cf2386a95c372d295b0b, disabling compactions & flushes 2023-07-24 17:08:57,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:57,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:57,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. after waiting 0 ms 2023-07-24 17:08:57,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:57,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:57,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 567f89c39ebe1ee74660552eab468f4e, disabling compactions & flushes 2023-07-24 17:08:57,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:57,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:57,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. after waiting 0 ms 2023-07-24 17:08:57,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:57,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:57,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:57,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b. 2023-07-24 17:08:57,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 131380d79752cf2386a95c372d295b0b: 2023-07-24 17:08:57,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:08:57,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:08:57,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e. 2023-07-24 17:08:57,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 567f89c39ebe1ee74660552eab468f4e: 2023-07-24 17:08:57,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:57,272 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=131380d79752cf2386a95c372d295b0b, regionState=CLOSED 2023-07-24 17:08:57,272 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218537272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218537272"}]},"ts":"1690218537272"} 2023-07-24 17:08:57,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:57,273 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=567f89c39ebe1ee74660552eab468f4e, regionState=CLOSED 2023-07-24 17:08:57,273 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690218537273"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218537273"}]},"ts":"1690218537273"} 2023-07-24 17:08:57,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-24 17:08:57,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 131380d79752cf2386a95c372d295b0b, server=jenkins-hbase4.apache.org,42771,1690218390000 in 180 msec 2023-07-24 17:08:57,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=131380d79752cf2386a95c372d295b0b, UNASSIGN in 190 msec 2023-07-24 17:08:57,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-24 17:08:57,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 567f89c39ebe1ee74660552eab468f4e, server=jenkins-hbase4.apache.org,40941,1690218389929 in 184 msec 2023-07-24 17:08:57,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-24 17:08:57,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=567f89c39ebe1ee74660552eab468f4e, UNASSIGN in 194 msec 2023-07-24 17:08:57,283 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218537283"}]},"ts":"1690218537283"} 2023-07-24 17:08:57,285 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 17:08:57,286 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 17:08:57,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 213 msec 2023-07-24 17:08:57,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 17:08:57,386 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 17:08:57,388 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,394 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,396 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,397 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,400 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,400 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,401 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,401 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 17:08:57,402 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 17:08:57,402 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:57,402 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:57,402 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 17:08:57,403 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,403 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:57,403 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,403 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:57,403 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,403 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:57,403 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:57,403 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 17:08:57,403 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 17:08:57,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 17:08:57,405 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/recovered.edits] 2023-07-24 17:08:57,406 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/recovered.edits] 2023-07-24 17:08:57,413 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/cf/34ef0e9d5b7d4c9980a21a054c2ce98e to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/cf/34ef0e9d5b7d4c9980a21a054c2ce98e 2023-07-24 17:08:57,414 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/cf/c31eeacd157a496e86a8c8a6ddc9634e to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/cf/c31eeacd157a496e86a8c8a6ddc9634e 2023-07-24 17:08:57,421 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b/recovered.edits/9.seqid 2023-07-24 17:08:57,421 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e/recovered.edits/9.seqid 2023-07-24 17:08:57,421 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/131380d79752cf2386a95c372d295b0b 2023-07-24 17:08:57,421 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testEmptyExportFileSystemState/567f89c39ebe1ee74660552eab468f4e 2023-07-24 17:08:57,421 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 17:08:57,422 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 17:08:57,423 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-24 17:08:57,429 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307245cde8c4a05c441bcbfcbb2bf5dd5c2f5 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307245cde8c4a05c441bcbfcbb2bf5dd5c2f5 2023-07-24 17:08:57,430 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307248902816dc01f4a32ad1ed047c11dd605 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307248902816dc01f4a32ad1ed047c11dd605 2023-07-24 17:08:57,431 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 17:08:57,434 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,436 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 17:08:57,438 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 17:08:57,439 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,439 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 17:08:57,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218537439"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:57,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218537439"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:57,441 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:08:57,442 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 567f89c39ebe1ee74660552eab468f4e, NAME => 'testtb-testEmptyExportFileSystemState,,1690218523799.567f89c39ebe1ee74660552eab468f4e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 131380d79752cf2386a95c372d295b0b, NAME => 'testtb-testEmptyExportFileSystemState,1,1690218523799.131380d79752cf2386a95c372d295b0b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:08:57,442 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 17:08:57,442 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218537442"}]},"ts":"9223372036854775807"} 2023-07-24 17:08:57,443 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 17:08:57,445 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 17:08:57,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 57 msec 2023-07-24 17:08:57,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 17:08:57,506 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 17:08:57,515 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 17:08:57,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:57,520 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 17:08:57,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 17:08:57,559 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 760) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:33193 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:48702 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:33366 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_373714292_1 at /127.0.0.1:33334 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:43923 from appattempt_1690218397883_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:45844 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_373714292_1 at /127.0.0.1:45818 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4677 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:42553 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=918 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=675 (was 657) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 186), AvailableMemoryMB=4136 (was 4529) 2023-07-24 17:08:57,559 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 17:08:57,599 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=675, ProcessCount=183, AvailableMemoryMB=4130 2023-07-24 17:08:57,599 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 17:08:57,601 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 17:08:57,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:57,605 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 17:08:57,605 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 17:08:57,606 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 17:08:57,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 17:08:57,609 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:08:57,609 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803 2023-07-24 17:08:57,610 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4 empty. 2023-07-24 17:08:57,610 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803 empty. 2023-07-24 17:08:57,611 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:08:57,611 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803 2023-07-24 17:08:57,611 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 17:08:57,661 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 17:08:57,663 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7c273e4180f9f47d9e55157e851a70c4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:08:57,663 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => a5b7072273168b338552db15b228b803, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp 2023-07-24 17:08:57,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 17:08:57,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:57,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing a5b7072273168b338552db15b228b803, disabling compactions & flushes 2023-07-24 17:08:57,726 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:57,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:57,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:57,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 7c273e4180f9f47d9e55157e851a70c4, disabling compactions & flushes 2023-07-24 17:08:57,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. after waiting 0 ms 2023-07-24 17:08:57,726 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:57,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:57,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:57,726 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:57,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. after waiting 0 ms 2023-07-24 17:08:57,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:57,727 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:57,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for a5b7072273168b338552db15b228b803: 2023-07-24 17:08:57,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 7c273e4180f9f47d9e55157e851a70c4: 2023-07-24 17:08:57,731 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 17:08:57,733 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218537732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218537732"}]},"ts":"1690218537732"} 2023-07-24 17:08:57,733 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218537732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218537732"}]},"ts":"1690218537732"} 2023-07-24 17:08:57,735 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 17:08:57,736 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 17:08:57,736 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218537736"}]},"ts":"1690218537736"} 2023-07-24 17:08:57,738 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 17:08:57,747 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 17:08:57,749 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 17:08:57,749 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 17:08:57,749 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 17:08:57,749 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 17:08:57,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c273e4180f9f47d9e55157e851a70c4, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a5b7072273168b338552db15b228b803, ASSIGN}] 2023-07-24 17:08:57,752 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a5b7072273168b338552db15b228b803, ASSIGN 2023-07-24 17:08:57,752 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c273e4180f9f47d9e55157e851a70c4, ASSIGN 2023-07-24 17:08:57,753 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a5b7072273168b338552db15b228b803, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42771,1690218390000; forceNewPlan=false, retain=false 2023-07-24 17:08:57,753 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c273e4180f9f47d9e55157e851a70c4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45037,1690218390043; forceNewPlan=false, retain=false 2023-07-24 17:08:57,903 INFO [jenkins-hbase4:39283] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 17:08:57,907 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7c273e4180f9f47d9e55157e851a70c4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:57,907 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218537907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218537907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218537907"}]},"ts":"1690218537907"} 2023-07-24 17:08:57,907 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a5b7072273168b338552db15b228b803, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:57,908 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218537907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218537907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218537907"}]},"ts":"1690218537907"} 2023-07-24 17:08:57,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 17:08:57,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 7c273e4180f9f47d9e55157e851a70c4, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:08:57,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure a5b7072273168b338552db15b228b803, server=jenkins-hbase4.apache.org,42771,1690218390000}] 2023-07-24 17:08:58,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:58,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5b7072273168b338552db15b228b803, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 17:08:58,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. service=AccessControlService 2023-07-24 17:08:58,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:58,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a5b7072273168b338552db15b228b803 2023-07-24 17:08:58,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:58,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a5b7072273168b338552db15b228b803 2023-07-24 17:08:58,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a5b7072273168b338552db15b228b803 2023-07-24 17:08:58,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:58,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c273e4180f9f47d9e55157e851a70c4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 17:08:58,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. service=AccessControlService 2023-07-24 17:08:58,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 17:08:58,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:08:58,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 17:08:58,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:08:58,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:08:58,085 INFO [StoreOpener-a5b7072273168b338552db15b228b803-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a5b7072273168b338552db15b228b803 2023-07-24 17:08:58,087 DEBUG [StoreOpener-a5b7072273168b338552db15b228b803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/cf 2023-07-24 17:08:58,087 DEBUG [StoreOpener-a5b7072273168b338552db15b228b803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/cf 2023-07-24 17:08:58,087 INFO [StoreOpener-a5b7072273168b338552db15b228b803-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5b7072273168b338552db15b228b803 columnFamilyName cf 2023-07-24 17:08:58,089 INFO [StoreOpener-a5b7072273168b338552db15b228b803-1] regionserver.HStore(310): Store=a5b7072273168b338552db15b228b803/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:58,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803 2023-07-24 17:08:58,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803 2023-07-24 17:08:58,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a5b7072273168b338552db15b228b803 2023-07-24 17:08:58,102 INFO [StoreOpener-7c273e4180f9f47d9e55157e851a70c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:08:58,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:58,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a5b7072273168b338552db15b228b803; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61075066, jitterRate=-0.0899105966091156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:58,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a5b7072273168b338552db15b228b803: 2023-07-24 17:08:58,120 DEBUG [StoreOpener-7c273e4180f9f47d9e55157e851a70c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/cf 2023-07-24 17:08:58,120 DEBUG [StoreOpener-7c273e4180f9f47d9e55157e851a70c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/cf 2023-07-24 17:08:58,121 INFO [StoreOpener-7c273e4180f9f47d9e55157e851a70c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c273e4180f9f47d9e55157e851a70c4 columnFamilyName cf 2023-07-24 17:08:58,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803., pid=109, masterSystemTime=1690218538066 2023-07-24 17:08:58,124 INFO [StoreOpener-7c273e4180f9f47d9e55157e851a70c4-1] regionserver.HStore(310): Store=7c273e4180f9f47d9e55157e851a70c4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 17:08:58,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:58,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:58,124 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a5b7072273168b338552db15b228b803, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,125 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218538124"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218538124"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218538124"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218538124"}]},"ts":"1690218538124"} 2023-07-24 17:08:58,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:08:58,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:08:58,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-24 17:08:58,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure a5b7072273168b338552db15b228b803, server=jenkins-hbase4.apache.org,42771,1690218390000 in 213 msec 2023-07-24 17:08:58,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a5b7072273168b338552db15b228b803, ASSIGN in 380 msec 2023-07-24 17:08:58,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:08:58,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 17:08:58,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c273e4180f9f47d9e55157e851a70c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73458726, jitterRate=0.09462031722068787}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 17:08:58,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c273e4180f9f47d9e55157e851a70c4: 2023-07-24 17:08:58,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4., pid=108, masterSystemTime=1690218538067 2023-07-24 17:08:58,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:58,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:58,154 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7c273e4180f9f47d9e55157e851a70c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,155 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218538154"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690218538154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690218538154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690218538154"}]},"ts":"1690218538154"} 2023-07-24 17:08:58,165 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-24 17:08:58,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 7c273e4180f9f47d9e55157e851a70c4, server=jenkins-hbase4.apache.org,45037,1690218390043 in 244 msec 2023-07-24 17:08:58,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-24 17:08:58,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c273e4180f9f47d9e55157e851a70c4, ASSIGN in 417 msec 2023-07-24 17:08:58,170 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 17:08:58,170 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218538170"}]},"ts":"1690218538170"} 2023-07-24 17:08:58,172 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 17:08:58,176 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 17:08:58,176 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 17:08:58,178 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 17:08:58,181 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:58,181 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:58,181 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:58,181 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:08:58,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:58,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:58,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:58,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 17:08:58,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 582 msec 2023-07-24 17:08:58,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 17:08:58,210 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 17:08:58,212 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,212 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:58,214 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:58,233 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:08:58,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218538233 (current time:1690218538233). 2023-07-24 17:08:58,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:58,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x67afbf30 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:58,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63113d61, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:58,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:58,290 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:58,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67afbf30 to 127.0.0.1:49485 2023-07-24 17:08:58,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:58,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x330c6db3 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:58,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@294012dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:58,374 DEBUG [hconnection-0x4350c8a1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:58,380 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:58,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x330c6db3 to 127.0.0.1:49485 2023-07-24 17:08:58,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:58,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 17:08:58,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:58,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:08:58,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:08:58,389 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:08:58,390 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690219138390 2023-07-24 17:08:58,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:08:58,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,394 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:58,394 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:58,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:08:58,396 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:08:58,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-24 17:08:58,400 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:08:58,400 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690219138400 2023-07-24 17:08:58,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,419 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 17:08:58,419 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:58,420 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 17:08:58,420 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 17:08:58,494 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:58,498 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 17:08:58,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:58,499 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,500 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:58,501 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,501 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,501 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,501 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,503 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,503 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,504 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,504 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:58,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 17:08:58,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 17:08:58,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 17:08:58,504 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:08:58,504 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:08:58,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:08:58,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,507 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:08:58,507 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:58,516 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:08:58,516 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:08:58,516 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:08:58,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,527 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:08:58,527 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:58,527 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:08:58,528 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:08:58,529 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:08:58,528 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:58,529 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:08:58,530 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:08:58,530 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:08:58,530 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,530 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,530 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:08:58,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,531 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,531 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,533 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:58,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:58,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 17:08:58,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@350b150e[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:58,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 17:08:58,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@350b150e[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:58,538 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 17:08:58,538 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,540 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,540 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,540 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,540 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:08:58,540 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,540 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,541 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:58,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,542 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:08:58,542 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:08:58,542 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:08:58,542 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:08:58,542 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:58,543 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:58,543 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:58,543 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. started... 2023-07-24 17:08:58,543 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c273e4180f9f47d9e55157e851a70c4: 2023-07-24 17:08:58,543 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,543 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:58,543 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:58,543 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:58,544 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:58,544 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:58,544 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. started... 2023-07-24 17:08:58,546 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a5b7072273168b338552db15b228b803: 2023-07-24 17:08:58,546 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,546 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:58,546 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:08:58,547 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:58,547 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:08:58,551 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 17:08:58,599 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. completed. 2023-07-24 17:08:58,599 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:58,599 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:58,599 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:58,599 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,599 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:08:58,599 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:08:58,599 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. completed. 2023-07-24 17:08:58,599 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:58,599 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:58,600 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:58,600 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,600 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:08:58,600 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:08:58,601 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:08:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:58,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:08:58,603 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,603 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:08:58,604 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:58,604 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:08:58,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42771,1690218390000': 2023-07-24 17:08:58,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 17:08:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:08:58,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 17:08:58,613 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 17:08:58,613 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:58,613 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:58,613 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,613 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:58,615 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,615 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,616 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,616 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,617 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,619 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,620 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,620 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,626 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:58,626 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,628 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,627 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,628 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:08:58,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 17:08:58,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,675 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 17:08:58,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,676 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690218538390Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690218538636 (+246 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690218538636Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690218538636Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690218538640 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690218538652 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690218538675 (+23 ms) 2023-07-24 17:08:58,679 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:08:58,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 287 msec 2023-07-24 17:08:58,700 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:58,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 17:08:58,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:58,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:58,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42771] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 17:08:58,708 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,709 DEBUG [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:58,709 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 17:08:58,720 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:08:58,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690218538720 (current time:1690218538720). 2023-07-24 17:08:58,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 17:08:58,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x26aab2e7 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:58,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@637a7353, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:58,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:58,733 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:58,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26aab2e7 to 127.0.0.1:49485 2023-07-24 17:08:58,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:58,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(139): Connect 0x3fea7fc5 to 127.0.0.1:49485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 17:08:58,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c24cf55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 17:08:58,744 DEBUG [hconnection-0x7c74dd69-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 17:08:58,745 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 17:08:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fea7fc5 to 127.0.0.1:49485 2023-07-24 17:08:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:08:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 17:08:58,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 17:08:58,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:08:58,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:08:58,754 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:08:58,755 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690219138755 2023-07-24 17:08:58,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 17:08:58,755 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,756 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 17:08:58,756 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 17:08:58,757 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 17:08:58,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:08:58,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-24 17:08:58,759 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:08:58,759 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690219138759 2023-07-24 17:08:58,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,768 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 17:08:58,768 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:58,769 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 17:08:58,769 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 17:08:58,770 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,770 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,771 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,771 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,771 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,771 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,772 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,772 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,772 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,772 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 17:08:58,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:08:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:08:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:58,776 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:08:58,776 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:08:58,776 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:08:58,776 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:08:58,776 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40941,1690218389929' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:08:58,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,776 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:08:58,776 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 17:08:58,776 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 17:08:58,777 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 17:08:58,777 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 17:08:58,777 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 17:08:58,778 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,779 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,779 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,779 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,779 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,779 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,779 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,779 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,779 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:58,779 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,780 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 17:08:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45037,1690218390043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 17:08:58,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b06333d[Count = 1] remaining members to acquire global barrier 2023-07-24 17:08:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42771,1690218390000' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 17:08:58,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b06333d[Count = 0] remaining members to acquire global barrier 2023-07-24 17:08:58,784 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 17:08:58,784 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:08:58,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,791 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,791 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:08:58,791 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:08:58,791 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40941,1690218389929' in zk 2023-07-24 17:08:58,791 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 17:08:58,791 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:58,792 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:58,792 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 17:08:58,792 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 17:08:58,792 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:58,792 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,792 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 17:08:58,792 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:58,792 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. started... 2023-07-24 17:08:58,792 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. started... 2023-07-24 17:08:58,792 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7c273e4180f9f47d9e55157e851a70c4 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 17:08:58,792 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a5b7072273168b338552db15b228b803 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 17:08:58,793 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:08:58,793 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:58,793 DEBUG [member: 'jenkins-hbase4.apache.org,40941,1690218389929' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:08:58,823 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724ffe9d890251d4be4a008f1b4d805bbce to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffe9d890251d4be4a008f1b4d805bbce 2023-07-24 17:08:58,825 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724212777be638f4b3b8757d769a6a273ac to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724212777be638f4b3b8757d769a6a273ac 2023-07-24 17:08:58,838 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/.tmp/cf/45be8a1a944544f8b91aea106ee3f127 2023-07-24 17:08:58,843 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/.tmp/cf/870e1222e72f4fb89c908a2c901c9846 2023-07-24 17:08:58,845 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/.tmp/cf/45be8a1a944544f8b91aea106ee3f127 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/cf/45be8a1a944544f8b91aea106ee3f127 2023-07-24 17:08:58,848 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/.tmp/cf/870e1222e72f4fb89c908a2c901c9846 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/cf/870e1222e72f4fb89c908a2c901c9846 2023-07-24 17:08:58,850 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/cf/45be8a1a944544f8b91aea106ee3f127, entries=4, sequenceid=6, filesize=5.6 K 2023-07-24 17:08:58,851 INFO [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 7c273e4180f9f47d9e55157e851a70c4 in 59ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:58,851 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 17:08:58,851 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c273e4180f9f47d9e55157e851a70c4: 2023-07-24 17:08:58,851 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,851 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:58,851 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/cf/45be8a1a944544f8b91aea106ee3f127] hfiles 2023-07-24 17:08:58,851 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/cf/45be8a1a944544f8b91aea106ee3f127 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,852 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/cf/870e1222e72f4fb89c908a2c901c9846, entries=46, sequenceid=6, filesize=13.2 K 2023-07-24 17:08:58,853 INFO [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a5b7072273168b338552db15b228b803 in 61ms, sequenceid=6, compaction requested=false 2023-07-24 17:08:58,855 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a5b7072273168b338552db15b228b803: 2023-07-24 17:08:58,855 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,855 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 17:08:58,855 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/cf/870e1222e72f4fb89c908a2c901c9846] hfiles 2023-07-24 17:08:58,855 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/cf/870e1222e72f4fb89c908a2c901c9846 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,857 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:58,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 17:08:58,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 17:08:58,858 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 17:08:58,863 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. completed. 2023-07-24 17:08:58,863 DEBUG [rs(jenkins-hbase4.apache.org,45037,1690218390043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:08:58,863 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:58,863 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:58,863 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,863 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:08:58,863 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45037,1690218390043' in zk 2023-07-24 17:08:58,865 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:08:58,865 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,865 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,865 DEBUG [member: 'jenkins-hbase4.apache.org,45037,1690218390043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:08:58,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,866 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. completed. 2023-07-24 17:08:58,866 DEBUG [rs(jenkins-hbase4.apache.org,42771,1690218390000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:08:58,866 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 17:08:58,866 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 17:08:58,866 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,867 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 17:08:58,867 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42771,1690218390000' in zk 2023-07-24 17:08:58,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,868 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 17:08:58,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1690218390000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 17:08:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45037,1690218390043': 2023-07-24 17:08:58,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45037,1690218390043' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 17:08:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42771,1690218390000': 2023-07-24 17:08:58,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42771,1690218390000' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 17:08:58,876 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 17:08:58,876 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 17:08:58,876 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 17:08:58,876 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,876 INFO [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 17:08:58,878 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,878 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,878 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 17:08:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 17:08:58,878 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,878 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,878 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,879 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,878 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 17:08:58,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,879 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,879 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 17:08:58,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,881 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 17:08:58,882 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,882 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,884 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,884 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,884 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,884 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,884 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,884 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,885 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,885 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 17:08:58,885 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,885 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 17:08:58,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,885 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 17:08:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 17:08:58,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,885 DEBUG [(jenkins-hbase4.apache.org,39283,1690218388485)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 17:08:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,885 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:08:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 17:08:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 17:08:58,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 17:08:58,887 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,887 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:08:58,887 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:08:58,887 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,887 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724212777be638f4b3b8757d769a6a273ac, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffe9d890251d4be4a008f1b4d805bbce] mob files 2023-07-24 17:08:58,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724212777be638f4b3b8757d769a6a273ac 2023-07-24 17:08:58,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffe9d890251d4be4a008f1b4d805bbce 2023-07-24 17:08:58,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 17:08:58,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,963 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:58,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690218538755Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690218538895 (+140 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690218538895Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690218538895Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690218538899 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690218538919 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690218538963 (+44 ms) 2023-07-24 17:08:58,966 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 17:08:58,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 210 msec 2023-07-24 17:08:59,058 DEBUG [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 17:08:59,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 17:08:59,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 17:08:59,060 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060 2023-07-24 17:08:59,060 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45525, tgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060, rawTgtDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060, srcFsUri=hdfs://localhost:45525, srcDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:08:59,083 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26 2023-07-24 17:08:59,083 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1649916662_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:59,083 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45525, inputRoot=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26, snapshotDir=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 17:08:59,091 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:08:59,111 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,112 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,112 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,112 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,113 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,113 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,113 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,184 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/hadoop-952602142060401438.jar 2023-07-24 17:08:59,185 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,185 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,185 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,186 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,186 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,186 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 17:08:59,187 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 17:08:59,187 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 17:08:59,188 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 17:08:59,188 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 17:08:59,189 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 17:08:59,189 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 17:08:59,189 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 17:08:59,190 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 17:08:59,190 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 17:08:59,191 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 17:08:59,191 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:59,192 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:59,192 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:59,192 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:59,193 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 17:08:59,193 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:08:59,193 DEBUG [Listener at jenkins-hbase4.apache.org/33193] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 17:09:00,074 WARN [Listener at jenkins-hbase4.apache.org/33193] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 17:09:00,077 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 17:09:00,079 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-24 17:09:01,454 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:09:01,454 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 17:09:01,456 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0006_000001 (auth:SIMPLE) 2023-07-24 17:09:01,501 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0007_000001 (auth:SIMPLE) 2023-07-24 17:09:02,866 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:09:06,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0007_000001 (auth:SIMPLE) 2023-07-24 17:09:08,677 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0007_000001 (auth:SIMPLE) 2023-07-24 17:09:13,749 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0007_000001 (auth:SIMPLE) 2023-07-24 17:09:15,725 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 17:09:15,726 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 17:09:15,784 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:15,784 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 17:09:15,785 INFO [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 17:09:15,785 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:15,786 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 17:09:15,786 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 17:09:15,786 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095395007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:15,787 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 17:09:15,787 DEBUG [Listener at jenkins-hbase4.apache.org/33193] snapshot.TestExportSnapshot(367): hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/export-test/export-1690218539060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 17:09:15,802 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:15,802 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:15,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:15,816 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218555816"}]},"ts":"1690218555816"} 2023-07-24 17:09:15,817 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 17:09:15,819 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 17:09:15,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c273e4180f9f47d9e55157e851a70c4, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a5b7072273168b338552db15b228b803, UNASSIGN}] 2023-07-24 17:09:15,821 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a5b7072273168b338552db15b228b803, UNASSIGN 2023-07-24 17:09:15,824 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c273e4180f9f47d9e55157e851a70c4, UNASSIGN 2023-07-24 17:09:15,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 17:09:15,825 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a5b7072273168b338552db15b228b803, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:09:15,825 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218555825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218555825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218555825"}]},"ts":"1690218555825"} 2023-07-24 17:09:15,829 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7c273e4180f9f47d9e55157e851a70c4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:09:15,829 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218555829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690218555829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690218555829"}]},"ts":"1690218555829"} 2023-07-24 17:09:15,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure a5b7072273168b338552db15b228b803, server=jenkins-hbase4.apache.org,42771,1690218390000}] 2023-07-24 17:09:15,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 7c273e4180f9f47d9e55157e851a70c4, server=jenkins-hbase4.apache.org,45037,1690218390043}] 2023-07-24 17:09:15,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 17:09:15,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:09:15,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a5b7072273168b338552db15b228b803 2023-07-24 17:09:15,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c273e4180f9f47d9e55157e851a70c4, disabling compactions & flushes 2023-07-24 17:09:15,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a5b7072273168b338552db15b228b803, disabling compactions & flushes 2023-07-24 17:09:15,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:09:15,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:09:15,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:09:15,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:09:15,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. after waiting 0 ms 2023-07-24 17:09:15,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:09:15,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. after waiting 0 ms 2023-07-24 17:09:15,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:09:16,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:09:16,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:09:16,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:16,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803. 2023-07-24 17:09:16,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a5b7072273168b338552db15b228b803: 2023-07-24 17:09:16,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:16,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4. 2023-07-24 17:09:16,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c273e4180f9f47d9e55157e851a70c4: 2023-07-24 17:09:16,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a5b7072273168b338552db15b228b803 2023-07-24 17:09:16,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:09:16,054 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a5b7072273168b338552db15b228b803, regionState=CLOSED 2023-07-24 17:09:16,055 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218556054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218556054"}]},"ts":"1690218556054"} 2023-07-24 17:09:16,058 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7c273e4180f9f47d9e55157e851a70c4, regionState=CLOSED 2023-07-24 17:09:16,058 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690218556057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690218556057"}]},"ts":"1690218556057"} 2023-07-24 17:09:16,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-24 17:09:16,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure a5b7072273168b338552db15b228b803, server=jenkins-hbase4.apache.org,42771,1690218390000 in 227 msec 2023-07-24 17:09:16,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-24 17:09:16,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 7c273e4180f9f47d9e55157e851a70c4, server=jenkins-hbase4.apache.org,45037,1690218390043 in 227 msec 2023-07-24 17:09:16,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a5b7072273168b338552db15b228b803, UNASSIGN in 242 msec 2023-07-24 17:09:16,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-24 17:09:16,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7c273e4180f9f47d9e55157e851a70c4, UNASSIGN in 250 msec 2023-07-24 17:09:16,078 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690218556077"}]},"ts":"1690218556077"} 2023-07-24 17:09:16,080 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 17:09:16,081 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 17:09:16,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 279 msec 2023-07-24 17:09:16,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 17:09:16,127 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 17:09:16,128 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,136 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,142 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,148 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40941] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,152 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,152 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,152 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,152 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,152 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 17:09:16,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 17:09:16,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 17:09:16,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 17:09:16,157 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:09:16,157 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,157 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:16,157 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,157 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,157 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,157 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:16,157 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:16,157 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803 2023-07-24 17:09:16,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 17:09:16,157 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 17:09:16,160 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/recovered.edits] 2023-07-24 17:09:16,164 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/cf, FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/recovered.edits] 2023-07-24 17:09:16,166 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/cf/45be8a1a944544f8b91aea106ee3f127 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/cf/45be8a1a944544f8b91aea106ee3f127 2023-07-24 17:09:16,173 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4/recovered.edits/9.seqid 2023-07-24 17:09:16,174 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7c273e4180f9f47d9e55157e851a70c4 2023-07-24 17:09:16,175 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/cf/870e1222e72f4fb89c908a2c901c9846 to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/cf/870e1222e72f4fb89c908a2c901c9846 2023-07-24 17:09:16,181 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/recovered.edits/9.seqid to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803/recovered.edits/9.seqid 2023-07-24 17:09:16,182 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a5b7072273168b338552db15b228b803 2023-07-24 17:09:16,182 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 17:09:16,182 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 17:09:16,183 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-24 17:09:16,189 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724212777be638f4b3b8757d769a6a273ac to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724212777be638f4b3b8757d769a6a273ac 2023-07-24 17:09:16,192 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffe9d890251d4be4a008f1b4d805bbce to hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffe9d890251d4be4a008f1b4d805bbce 2023-07-24 17:09:16,193 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 17:09:16,198 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,201 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 17:09:16,206 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 17:09:16,215 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,215 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 17:09:16,215 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218556215"}]},"ts":"9223372036854775807"} 2023-07-24 17:09:16,216 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690218556215"}]},"ts":"9223372036854775807"} 2023-07-24 17:09:16,244 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 17:09:16,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7c273e4180f9f47d9e55157e851a70c4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690218537600.7c273e4180f9f47d9e55157e851a70c4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a5b7072273168b338552db15b228b803, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690218537600.a5b7072273168b338552db15b228b803.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 17:09:16,244 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 17:09:16,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690218556244"}]},"ts":"9223372036854775807"} 2023-07-24 17:09:16,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 17:09:16,263 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 17:09:16,268 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 140 msec 2023-07-24 17:09:16,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 17:09:16,461 INFO [Listener at jenkins-hbase4.apache.org/33193] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 17:09:16,472 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 17:09:16,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,476 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 17:09:16,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39283] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 17:09:16,521 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 762) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:36668 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1126726253_1 at /127.0.0.1:33022 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1126726253_1 at /127.0.0.1:36656 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5317 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:52398 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: java.util.concurrent.ThreadPoolExecutor$Worker@7147120a[State = -1, empty queue] sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x502bdebf-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095395007_17 at /127.0.0.1:33056 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:36459 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 918), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=667 (was 675), ProcessCount=189 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=3746 (was 4130) 2023-07-24 17:09:16,522 WARN [Listener at jenkins-hbase4.apache.org/33193] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-24 17:09:16,522 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 17:09:16,552 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 17:09:19,938 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690218397883_0007_000001 (auth:SIMPLE) 2023-07-24 17:09:21,624 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 17:09:30,682 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 17:09:44,800 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 17:09:44,801 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 17:09:44,914 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 17:09:44,928 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 17:09:44,929 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 17:09:44,944 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 17:09:45,048 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 17:09:45,048 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 17:09:45,048 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 17:09:45,048 INFO [Listener at jenkins-hbase4.apache.org/33193] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 17:09:45,049 DEBUG [Listener at jenkins-hbase4.apache.org/33193] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x207f6c1a to 127.0.0.1:49485 2023-07-24 17:09:45,049 DEBUG [Listener at jenkins-hbase4.apache.org/33193] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:45,049 DEBUG [Listener at jenkins-hbase4.apache.org/33193] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 17:09:45,049 DEBUG [Listener at jenkins-hbase4.apache.org/33193] util.JVMClusterUtil(257): Found active master hash=530252361, stopped=false 2023-07-24 17:09:45,049 DEBUG [Listener at jenkins-hbase4.apache.org/33193] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:45,050 DEBUG [Listener at jenkins-hbase4.apache.org/33193] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 17:09:45,050 INFO [Listener at jenkins-hbase4.apache.org/33193] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:09:45,051 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 17:09:45,051 INFO [Listener at jenkins-hbase4.apache.org/33193] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 17:09:45,052 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 17:09:45,052 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 17:09:45,052 DEBUG [Listener at jenkins-hbase4.apache.org/33193] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c57d4ea to 127.0.0.1:49485 2023-07-24 17:09:45,051 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 17:09:45,052 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:09:45,052 DEBUG [Listener at jenkins-hbase4.apache.org/33193] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:45,052 INFO [Listener at jenkins-hbase4.apache.org/33193] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40941,1690218389929' ***** 2023-07-24 17:09:45,052 DEBUG [Listener at jenkins-hbase4.apache.org/33193] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:45,052 INFO [Listener at jenkins-hbase4.apache.org/33193] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 17:09:45,053 INFO [Listener at jenkins-hbase4.apache.org/33193] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42771,1690218390000' ***** 2023-07-24 17:09:45,053 DEBUG [Listener at jenkins-hbase4.apache.org/33193] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:45,053 INFO [RS:0;jenkins-hbase4:40941] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 17:09:45,053 INFO [Listener at jenkins-hbase4.apache.org/33193] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 17:09:45,053 INFO [Listener at jenkins-hbase4.apache.org/33193] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45037,1690218390043' ***** 2023-07-24 17:09:45,053 INFO [RS:0;jenkins-hbase4:40941] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 17:09:45,053 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 17:09:45,053 INFO [RS:1;jenkins-hbase4:42771] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 17:09:45,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:09:45,053 DEBUG [Listener at jenkins-hbase4.apache.org/33193] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:45,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:09:45,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:09:45,053 INFO [RS:1;jenkins-hbase4:42771] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 17:09:45,053 INFO [RS:0;jenkins-hbase4:40941] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 17:09:45,054 INFO [RS:1;jenkins-hbase4:42771] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 17:09:45,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 17:09:45,054 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(3305): Received CLOSE for 7e2cce82bee9e461ff9ee44e54bcef49 2023-07-24 17:09:45,054 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(3305): Received CLOSE for cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:09:45,054 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:09:45,054 DEBUG [RS:0;jenkins-hbase4:40941] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x235ab950 to 127.0.0.1:49485 2023-07-24 17:09:45,053 INFO [Listener at jenkins-hbase4.apache.org/33193] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 17:09:45,055 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 17:09:45,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7e2cce82bee9e461ff9ee44e54bcef49, disabling compactions & flushes 2023-07-24 17:09:45,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:09:45,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:09:45,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. after waiting 0 ms 2023-07-24 17:09:45,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:09:45,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7e2cce82bee9e461ff9ee44e54bcef49 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 17:09:45,055 DEBUG [RS:0;jenkins-hbase4:40941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:45,054 INFO [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:09:45,055 INFO [RS:2;jenkins-hbase4:45037] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 17:09:45,057 INFO [RS:0;jenkins-hbase4:40941] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 17:09:45,057 INFO [RS:0;jenkins-hbase4:40941] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 17:09:45,057 INFO [RS:0;jenkins-hbase4:40941] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 17:09:45,056 DEBUG [RS:1;jenkins-hbase4:42771] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63d512e1 to 127.0.0.1:49485 2023-07-24 17:09:45,057 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 17:09:45,057 INFO [RS:2;jenkins-hbase4:45037] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 17:09:45,057 DEBUG [RS:1;jenkins-hbase4:42771] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:45,058 INFO [RS:2;jenkins-hbase4:45037] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 17:09:45,058 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 17:09:45,060 INFO [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:09:45,060 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-24 17:09:45,060 DEBUG [RS:2;jenkins-hbase4:45037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47831cf3 to 127.0.0.1:49485 2023-07-24 17:09:45,061 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1478): Online Regions={7e2cce82bee9e461ff9ee44e54bcef49=hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49., 1588230740=hbase:meta,,1.1588230740, cb4a43adcf555a87e4f3a1f473fa5c98=hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98.} 2023-07-24 17:09:45,060 INFO [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42771,1690218390000; all regions closed. 2023-07-24 17:09:45,061 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 17:09:45,061 DEBUG [RS:2;jenkins-hbase4:45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:45,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 17:09:45,061 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 17:09:45,061 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 17:09:45,061 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 17:09:45,062 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 17:09:45,062 DEBUG [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1504): Waiting on 1588230740, 7e2cce82bee9e461ff9ee44e54bcef49, cb4a43adcf555a87e4f3a1f473fa5c98 2023-07-24 17:09:45,069 INFO [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45037,1690218390043; all regions closed. 2023-07-24 17:09:45,091 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-24 17:09:45,091 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-24 17:09:45,098 DEBUG [RS:2;jenkins-hbase4:45037] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/oldWALs 2023-07-24 17:09:45,098 DEBUG [RS:1;jenkins-hbase4:42771] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/oldWALs 2023-07-24 17:09:45,098 INFO [RS:1;jenkins-hbase4:42771] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42771%2C1690218390000:(num 1690218392229) 2023-07-24 17:09:45,098 INFO [RS:2;jenkins-hbase4:45037] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45037%2C1690218390043:(num 1690218392239) 2023-07-24 17:09:45,098 DEBUG [RS:2;jenkins-hbase4:45037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:45,099 INFO [RS:2;jenkins-hbase4:45037] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:45,098 DEBUG [RS:1;jenkins-hbase4:42771] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:45,099 INFO [RS:1;jenkins-hbase4:42771] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:45,106 INFO [RS:1;jenkins-hbase4:42771] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 17:09:45,106 INFO [RS:2;jenkins-hbase4:45037] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 17:09:45,107 INFO [RS:1;jenkins-hbase4:42771] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 17:09:45,108 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 17:09:45,108 INFO [RS:1;jenkins-hbase4:42771] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 17:09:45,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49/.tmp/l/3f29c60833b0498f9efc8e1e263dc214 2023-07-24 17:09:45,107 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 17:09:45,107 INFO [RS:2;jenkins-hbase4:45037] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 17:09:45,108 INFO [RS:1;jenkins-hbase4:42771] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 17:09:45,108 INFO [RS:2;jenkins-hbase4:45037] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 17:09:45,109 INFO [RS:2;jenkins-hbase4:45037] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 17:09:45,110 INFO [RS:2;jenkins-hbase4:45037] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45037 2023-07-24 17:09:45,110 INFO [RS:1;jenkins-hbase4:42771] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42771 2023-07-24 17:09:45,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/.tmp/info/166de1147c134ee5b1a378410f539481 2023-07-24 17:09:45,116 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:09:45,116 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:45,116 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:09:45,116 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:45,116 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42771,1690218390000 2023-07-24 17:09:45,116 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:45,116 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:45,117 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:09:45,117 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:09:45,117 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42771,1690218390000] 2023-07-24 17:09:45,117 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45037,1690218390043 2023-07-24 17:09:45,118 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42771,1690218390000; numProcessing=1 2023-07-24 17:09:45,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f29c60833b0498f9efc8e1e263dc214 2023-07-24 17:09:45,119 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42771,1690218390000 already deleted, retry=false 2023-07-24 17:09:45,119 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42771,1690218390000 expired; onlineServers=2 2023-07-24 17:09:45,119 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45037,1690218390043] 2023-07-24 17:09:45,119 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45037,1690218390043; numProcessing=2 2023-07-24 17:09:45,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49/.tmp/l/3f29c60833b0498f9efc8e1e263dc214 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49/l/3f29c60833b0498f9efc8e1e263dc214 2023-07-24 17:09:45,120 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 166de1147c134ee5b1a378410f539481 2023-07-24 17:09:45,121 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45037,1690218390043 already deleted, retry=false 2023-07-24 17:09:45,121 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45037,1690218390043 expired; onlineServers=1 2023-07-24 17:09:45,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f29c60833b0498f9efc8e1e263dc214 2023-07-24 17:09:45,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49/l/3f29c60833b0498f9efc8e1e263dc214, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 17:09:45,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 7e2cce82bee9e461ff9ee44e54bcef49 in 72ms, sequenceid=18, compaction requested=false 2023-07-24 17:09:45,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/acl/7e2cce82bee9e461ff9ee44e54bcef49/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 17:09:45,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:45,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:09:45,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7e2cce82bee9e461ff9ee44e54bcef49: 2023-07-24 17:09:45,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690218393689.7e2cce82bee9e461ff9ee44e54bcef49. 2023-07-24 17:09:45,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb4a43adcf555a87e4f3a1f473fa5c98, disabling compactions & flushes 2023-07-24 17:09:45,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:09:45,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:09:45,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. after waiting 0 ms 2023-07-24 17:09:45,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:09:45,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cb4a43adcf555a87e4f3a1f473fa5c98 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 17:09:45,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/.tmp/rep_barrier/e5f594c97a784096a637ab66d8dc7e54 2023-07-24 17:09:45,143 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:45,145 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:45,146 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:45,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5f594c97a784096a637ab66d8dc7e54 2023-07-24 17:09:45,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98/.tmp/info/d7147c1ed3cd4dfdbddb90d33afde366 2023-07-24 17:09:45,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98/.tmp/info/d7147c1ed3cd4dfdbddb90d33afde366 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98/info/d7147c1ed3cd4dfdbddb90d33afde366 2023-07-24 17:09:45,165 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/.tmp/table/6f2dbc11fe4a427cb257f9fec259dc16 2023-07-24 17:09:45,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98/info/d7147c1ed3cd4dfdbddb90d33afde366, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 17:09:45,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cb4a43adcf555a87e4f3a1f473fa5c98 in 26ms, sequenceid=6, compaction requested=false 2023-07-24 17:09:45,172 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f2dbc11fe4a427cb257f9fec259dc16 2023-07-24 17:09:45,172 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/.tmp/info/166de1147c134ee5b1a378410f539481 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/info/166de1147c134ee5b1a378410f539481 2023-07-24 17:09:45,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/namespace/cb4a43adcf555a87e4f3a1f473fa5c98/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 17:09:45,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:45,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:09:45,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb4a43adcf555a87e4f3a1f473fa5c98: 2023-07-24 17:09:45,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690218392795.cb4a43adcf555a87e4f3a1f473fa5c98. 2023-07-24 17:09:45,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 166de1147c134ee5b1a378410f539481 2023-07-24 17:09:45,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/info/166de1147c134ee5b1a378410f539481, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 17:09:45,178 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/.tmp/rep_barrier/e5f594c97a784096a637ab66d8dc7e54 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/rep_barrier/e5f594c97a784096a637ab66d8dc7e54 2023-07-24 17:09:45,182 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5f594c97a784096a637ab66d8dc7e54 2023-07-24 17:09:45,182 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/rep_barrier/e5f594c97a784096a637ab66d8dc7e54, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 17:09:45,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/.tmp/table/6f2dbc11fe4a427cb257f9fec259dc16 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/table/6f2dbc11fe4a427cb257f9fec259dc16 2023-07-24 17:09:45,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f2dbc11fe4a427cb257f9fec259dc16 2023-07-24 17:09:45,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/table/6f2dbc11fe4a427cb257f9fec259dc16, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 17:09:45,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 126ms, sequenceid=131, compaction requested=false 2023-07-24 17:09:45,196 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 17:09:45,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 17:09:45,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 17:09:45,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 17:09:45,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 17:09:45,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 17:09:45,219 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:45,219 INFO [RS:1;jenkins-hbase4:42771] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42771,1690218390000; zookeeper connection closed. 2023-07-24 17:09:45,219 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x101984c5b6e0002, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:45,219 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@25ed32c9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@25ed32c9 2023-07-24 17:09:45,262 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40941,1690218389929; all regions closed. 2023-07-24 17:09:45,270 DEBUG [RS:0;jenkins-hbase4:40941] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/oldWALs 2023-07-24 17:09:45,270 INFO [RS:0;jenkins-hbase4:40941] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40941%2C1690218389929.meta:.meta(num 1690218392384) 2023-07-24 17:09:45,276 DEBUG [RS:0;jenkins-hbase4:40941] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/oldWALs 2023-07-24 17:09:45,276 INFO [RS:0;jenkins-hbase4:40941] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40941%2C1690218389929:(num 1690218392239) 2023-07-24 17:09:45,276 DEBUG [RS:0;jenkins-hbase4:40941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:45,276 INFO [RS:0;jenkins-hbase4:40941] regionserver.LeaseManager(133): Closed leases 2023-07-24 17:09:45,276 INFO [RS:0;jenkins-hbase4:40941] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 17:09:45,276 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 17:09:45,277 INFO [RS:0;jenkins-hbase4:40941] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40941 2023-07-24 17:09:45,279 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40941,1690218389929 2023-07-24 17:09:45,279 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 17:09:45,281 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40941,1690218389929] 2023-07-24 17:09:45,281 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40941,1690218389929; numProcessing=3 2023-07-24 17:09:45,282 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40941,1690218389929 already deleted, retry=false 2023-07-24 17:09:45,282 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40941,1690218389929 expired; onlineServers=0 2023-07-24 17:09:45,282 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39283,1690218388485' ***** 2023-07-24 17:09:45,283 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 17:09:45,283 DEBUG [M:0;jenkins-hbase4:39283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ea60872, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 17:09:45,283 INFO [M:0;jenkins-hbase4:39283] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39283,1690218388485 2023-07-24 17:09:45,283 INFO [M:0;jenkins-hbase4:39283] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39283,1690218388485; all regions closed. 2023-07-24 17:09:45,283 DEBUG [M:0;jenkins-hbase4:39283] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 17:09:45,283 DEBUG [M:0;jenkins-hbase4:39283] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 17:09:45,283 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 17:09:45,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690218391687] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690218391687,5,FailOnTimeoutGroup] 2023-07-24 17:09:45,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690218391686] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690218391686,5,FailOnTimeoutGroup] 2023-07-24 17:09:45,283 DEBUG [M:0;jenkins-hbase4:39283] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 17:09:45,284 INFO [M:0;jenkins-hbase4:39283] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 17:09:45,284 INFO [M:0;jenkins-hbase4:39283] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 17:09:45,284 INFO [M:0;jenkins-hbase4:39283] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 17:09:45,284 DEBUG [M:0;jenkins-hbase4:39283] master.HMaster(1512): Stopping service threads 2023-07-24 17:09:45,284 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 17:09:45,284 INFO [M:0;jenkins-hbase4:39283] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 17:09:45,284 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 17:09:45,284 ERROR [M:0;jenkins-hbase4:39283] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 17:09:45,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 17:09:45,285 INFO [M:0;jenkins-hbase4:39283] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 17:09:45,285 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 17:09:45,285 DEBUG [M:0;jenkins-hbase4:39283] zookeeper.ZKUtil(398): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 17:09:45,286 WARN [M:0;jenkins-hbase4:39283] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 17:09:45,286 INFO [M:0;jenkins-hbase4:39283] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 17:09:45,286 INFO [M:0;jenkins-hbase4:39283] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 17:09:45,286 DEBUG [M:0;jenkins-hbase4:39283] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 17:09:45,286 INFO [M:0;jenkins-hbase4:39283] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:09:45,286 DEBUG [M:0;jenkins-hbase4:39283] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:09:45,286 DEBUG [M:0;jenkins-hbase4:39283] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 17:09:45,287 DEBUG [M:0;jenkins-hbase4:39283] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:09:45,287 INFO [M:0;jenkins-hbase4:39283] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.91 KB heapSize=452.12 KB 2023-07-24 17:09:45,305 INFO [M:0;jenkins-hbase4:39283] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.91 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1995fb5f0ea641d98b7f1881b401af18 2023-07-24 17:09:45,309 INFO [M:0;jenkins-hbase4:39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1995fb5f0ea641d98b7f1881b401af18 2023-07-24 17:09:45,310 DEBUG [M:0;jenkins-hbase4:39283] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1995fb5f0ea641d98b7f1881b401af18 as hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1995fb5f0ea641d98b7f1881b401af18 2023-07-24 17:09:45,315 INFO [M:0;jenkins-hbase4:39283] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1995fb5f0ea641d98b7f1881b401af18 2023-07-24 17:09:45,315 INFO [M:0;jenkins-hbase4:39283] regionserver.HStore(1080): Added hdfs://localhost:45525/user/jenkins/test-data/80b6bff7-21f2-b1e2-4489-e9b40df40b26/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1995fb5f0ea641d98b7f1881b401af18, entries=119, sequenceid=899, filesize=28.7 K 2023-07-24 17:09:45,316 INFO [M:0;jenkins-hbase4:39283] regionserver.HRegion(2948): Finished flush of dataSize ~375.91 KB/384930, heapSize ~452.10 KB/462952, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=899, compaction requested=false 2023-07-24 17:09:45,318 INFO [M:0;jenkins-hbase4:39283] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 17:09:45,318 DEBUG [M:0;jenkins-hbase4:39283] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 17:09:45,319 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:45,319 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:45037-0x101984c5b6e0003, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:45,319 INFO [RS:2;jenkins-hbase4:45037] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45037,1690218390043; zookeeper connection closed. 2023-07-24 17:09:45,320 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66f397b9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66f397b9 2023-07-24 17:09:45,322 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 17:09:45,322 INFO [M:0;jenkins-hbase4:39283] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 17:09:45,322 INFO [M:0;jenkins-hbase4:39283] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39283 2023-07-24 17:09:45,324 DEBUG [M:0;jenkins-hbase4:39283] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39283,1690218388485 already deleted, retry=false 2023-07-24 17:09:45,419 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:45,419 INFO [RS:0;jenkins-hbase4:40941] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40941,1690218389929; zookeeper connection closed. 2023-07-24 17:09:45,419 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): regionserver:40941-0x101984c5b6e0001, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:45,420 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4eb6d5bd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4eb6d5bd 2023-07-24 17:09:45,420 INFO [Listener at jenkins-hbase4.apache.org/33193] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 17:09:45,519 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:45,519 INFO [M:0;jenkins-hbase4:39283] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39283,1690218388485; zookeeper connection closed. 2023-07-24 17:09:45,519 DEBUG [Listener at localhost/37833-EventThread] zookeeper.ZKWatcher(600): master:39283-0x101984c5b6e0000, quorum=127.0.0.1:49485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 17:09:45,521 WARN [Listener at jenkins-hbase4.apache.org/33193] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 17:09:45,526 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 17:09:45,630 WARN [BP-1233609093-172.31.14.131-1690218384633 heartbeating to localhost/127.0.0.1:45525] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 17:09:45,630 WARN [BP-1233609093-172.31.14.131-1690218384633 heartbeating to localhost/127.0.0.1:45525] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1233609093-172.31.14.131-1690218384633 (Datanode Uuid a3d3e541-8ce7-4b0c-83d0-3affe9d25e07) service to localhost/127.0.0.1:45525 2023-07-24 17:09:45,632 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data5/current/BP-1233609093-172.31.14.131-1690218384633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:45,633 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data6/current/BP-1233609093-172.31.14.131-1690218384633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:45,635 WARN [Listener at jenkins-hbase4.apache.org/33193] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 17:09:45,640 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 17:09:45,744 WARN [BP-1233609093-172.31.14.131-1690218384633 heartbeating to localhost/127.0.0.1:45525] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 17:09:45,744 WARN [BP-1233609093-172.31.14.131-1690218384633 heartbeating to localhost/127.0.0.1:45525] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1233609093-172.31.14.131-1690218384633 (Datanode Uuid e6ceb162-eb6e-4b23-b1c0-384224e915f9) service to localhost/127.0.0.1:45525 2023-07-24 17:09:45,745 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data3/current/BP-1233609093-172.31.14.131-1690218384633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:45,745 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data4/current/BP-1233609093-172.31.14.131-1690218384633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:45,746 WARN [Listener at jenkins-hbase4.apache.org/33193] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 17:09:45,749 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 17:09:45,852 WARN [BP-1233609093-172.31.14.131-1690218384633 heartbeating to localhost/127.0.0.1:45525] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 17:09:45,852 WARN [BP-1233609093-172.31.14.131-1690218384633 heartbeating to localhost/127.0.0.1:45525] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1233609093-172.31.14.131-1690218384633 (Datanode Uuid d5918fc8-f1d3-4eea-a2bd-a23c88cfa0b1) service to localhost/127.0.0.1:45525 2023-07-24 17:09:45,853 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data1/current/BP-1233609093-172.31.14.131-1690218384633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:45,853 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/57aba875-d08f-6845-f2a4-6532c55408a4/cluster_28bc4b6f-3fc4-0760-ea9f-2b4b7a5da592/dfs/data/data2/current/BP-1233609093-172.31.14.131-1690218384633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 17:09:45,878 INFO [Listener at jenkins-hbase4.apache.org/33193] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 17:09:46,010 INFO [Listener at jenkins-hbase4.apache.org/33193] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 17:09:46,094 INFO [Listener at jenkins-hbase4.apache.org/33193] hbase.HBaseTestingUtility(1293): Minicluster is down