2023-07-16 01:10:58,572 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-16 01:10:58,833 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78 2023-07-16 01:10:58,833 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-16 01:10:58,834 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-16 01:10:58,875 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-16 01:10:59,191 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-16 01:10:59,192 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832, deleteOnExit=true 2023-07-16 01:10:59,192 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-16 01:10:59,193 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/test.cache.data in system properties and HBase conf 2023-07-16 01:10:59,193 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 01:10:59,194 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop.log.dir in system properties and HBase conf 2023-07-16 01:10:59,195 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 01:10:59,195 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 01:10:59,195 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 01:10:59,606 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-16 01:10:59,611 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 01:10:59,611 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 01:10:59,612 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 01:10:59,612 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 01:10:59,613 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 01:10:59,613 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 01:10:59,613 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 01:10:59,614 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 01:10:59,614 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 01:10:59,615 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/nfs.dump.dir in system properties and HBase conf 2023-07-16 01:10:59,615 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir in system properties and HBase conf 2023-07-16 01:10:59,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 01:10:59,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 01:10:59,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-16 01:11:00,263 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 01:11:00,268 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 01:11:00,645 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-16 01:11:00,864 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-16 01:11:00,878 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:00,924 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:00,969 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir/Jetty_localhost_38817_hdfs____.slmgsd/webapp 2023-07-16 01:11:01,169 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38817 2023-07-16 01:11:01,182 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 01:11:01,183 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 01:11:01,768 WARN [Listener at localhost/35755] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 01:11:01,863 WARN [Listener at localhost/35755] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 01:11:01,894 WARN [Listener at localhost/35755] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:01,904 INFO [Listener at localhost/35755] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:01,994 INFO [Listener at localhost/35755] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir/Jetty_localhost_36085_datanode____.8zmejz/webapp 2023-07-16 01:11:02,101 INFO [Listener at localhost/35755] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36085 2023-07-16 01:11:02,713 WARN [Listener at localhost/40865] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 01:11:02,753 WARN [Listener at localhost/40865] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 01:11:02,758 WARN [Listener at localhost/40865] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:02,761 INFO [Listener at localhost/40865] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:02,770 INFO [Listener at localhost/40865] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir/Jetty_localhost_38851_datanode____4zb4xi/webapp 2023-07-16 01:11:02,891 INFO [Listener at localhost/40865] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38851 2023-07-16 01:11:02,909 WARN [Listener at localhost/39543] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 01:11:02,967 WARN [Listener at localhost/39543] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 01:11:02,971 WARN [Listener at localhost/39543] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:02,972 INFO [Listener at localhost/39543] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:02,981 INFO [Listener at localhost/39543] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir/Jetty_localhost_44995_datanode____x7pblo/webapp 2023-07-16 01:11:03,142 INFO [Listener at localhost/39543] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44995 2023-07-16 01:11:03,166 WARN [Listener at localhost/36899] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 01:11:03,522 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3217228150b4eeb7: Processing first storage report for DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63 from datanode 2022eb44-02e1-411f-bb71-01c4942f55b6 2023-07-16 01:11:03,524 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3217228150b4eeb7: from storage DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63 node DatanodeRegistration(127.0.0.1:42767, datanodeUuid=2022eb44-02e1-411f-bb71-01c4942f55b6, infoPort=43051, infoSecurePort=0, ipcPort=40865, storageInfo=lv=-57;cid=testClusterID;nsid=1128394510;c=1689469860377), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,524 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f7fd122a52b0406: Processing first storage report for DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3 from datanode 0f458073-5724-474a-bef3-37b5346c9bc5 2023-07-16 01:11:03,524 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f7fd122a52b0406: from storage DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3 node DatanodeRegistration(127.0.0.1:46273, datanodeUuid=0f458073-5724-474a-bef3-37b5346c9bc5, infoPort=46745, infoSecurePort=0, ipcPort=39543, storageInfo=lv=-57;cid=testClusterID;nsid=1128394510;c=1689469860377), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,524 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3217228150b4eeb7: Processing first storage report for DS-26850068-bb85-457b-98f7-aa73affaeeee from datanode 2022eb44-02e1-411f-bb71-01c4942f55b6 2023-07-16 01:11:03,525 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3217228150b4eeb7: from storage DS-26850068-bb85-457b-98f7-aa73affaeeee node DatanodeRegistration(127.0.0.1:42767, datanodeUuid=2022eb44-02e1-411f-bb71-01c4942f55b6, infoPort=43051, infoSecurePort=0, ipcPort=40865, storageInfo=lv=-57;cid=testClusterID;nsid=1128394510;c=1689469860377), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,525 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x30a031e42c9c158f: Processing first storage report for DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc from datanode a78ed80b-c2e2-4a74-8b56-fbb911e4f409 2023-07-16 01:11:03,525 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x30a031e42c9c158f: from storage DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc node DatanodeRegistration(127.0.0.1:46855, datanodeUuid=a78ed80b-c2e2-4a74-8b56-fbb911e4f409, infoPort=40721, infoSecurePort=0, ipcPort=36899, storageInfo=lv=-57;cid=testClusterID;nsid=1128394510;c=1689469860377), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,525 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f7fd122a52b0406: Processing first storage report for DS-11174847-4698-41e2-8810-7a67e5c62298 from datanode 0f458073-5724-474a-bef3-37b5346c9bc5 2023-07-16 01:11:03,525 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f7fd122a52b0406: from storage DS-11174847-4698-41e2-8810-7a67e5c62298 node DatanodeRegistration(127.0.0.1:46273, datanodeUuid=0f458073-5724-474a-bef3-37b5346c9bc5, infoPort=46745, infoSecurePort=0, ipcPort=39543, storageInfo=lv=-57;cid=testClusterID;nsid=1128394510;c=1689469860377), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,525 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x30a031e42c9c158f: Processing first storage report for DS-3737c839-6af2-4ed6-9f26-0dd68641a0d4 from datanode a78ed80b-c2e2-4a74-8b56-fbb911e4f409 2023-07-16 01:11:03,525 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x30a031e42c9c158f: from storage DS-3737c839-6af2-4ed6-9f26-0dd68641a0d4 node DatanodeRegistration(127.0.0.1:46855, datanodeUuid=a78ed80b-c2e2-4a74-8b56-fbb911e4f409, infoPort=40721, infoSecurePort=0, ipcPort=36899, storageInfo=lv=-57;cid=testClusterID;nsid=1128394510;c=1689469860377), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,753 DEBUG [Listener at localhost/36899] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78 2023-07-16 01:11:03,905 INFO [Listener at localhost/36899] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/zookeeper_0, clientPort=55425, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-16 01:11:03,928 INFO [Listener at localhost/36899] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55425 2023-07-16 01:11:03,941 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:03,944 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:04,677 INFO [Listener at localhost/36899] util.FSUtils(471): Created version file at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 with version=8 2023-07-16 01:11:04,677 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/hbase-staging 2023-07-16 01:11:05,110 INFO [Listener at localhost/36899] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-16 01:11:05,777 INFO [Listener at localhost/36899] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 01:11:05,825 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:05,826 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:05,826 INFO [Listener at localhost/36899] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 01:11:05,826 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:05,826 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 01:11:06,037 INFO [Listener at localhost/36899] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 01:11:06,117 DEBUG [Listener at localhost/36899] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-16 01:11:06,246 INFO [Listener at localhost/36899] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34911 2023-07-16 01:11:06,261 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,263 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,289 INFO [Listener at localhost/36899] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34911 connecting to ZooKeeper ensemble=127.0.0.1:55425 2023-07-16 01:11:06,357 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:349110x0, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 01:11:06,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34911-0x1016baecab10000 connected 2023-07-16 01:11:06,427 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:11:06,428 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:11:06,446 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 01:11:06,458 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34911 2023-07-16 01:11:06,459 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34911 2023-07-16 01:11:06,460 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34911 2023-07-16 01:11:06,466 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34911 2023-07-16 01:11:06,467 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34911 2023-07-16 01:11:06,475 INFO [Listener at localhost/36899] master.HMaster(444): hbase.rootdir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660, hbase.cluster.distributed=false 2023-07-16 01:11:06,565 INFO [Listener at localhost/36899] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 01:11:06,565 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,565 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,565 INFO [Listener at localhost/36899] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 01:11:06,566 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,566 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 01:11:06,573 INFO [Listener at localhost/36899] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 01:11:06,576 INFO [Listener at localhost/36899] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46827 2023-07-16 01:11:06,580 INFO [Listener at localhost/36899] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 01:11:06,587 INFO [Listener at localhost/36899] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 01:11:06,589 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,591 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,593 INFO [Listener at localhost/36899] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46827 connecting to ZooKeeper ensemble=127.0.0.1:55425 2023-07-16 01:11:06,599 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:468270x0, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 01:11:06,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46827-0x1016baecab10001 connected 2023-07-16 01:11:06,600 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:11:06,601 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:11:06,602 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 01:11:06,603 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46827 2023-07-16 01:11:06,603 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46827 2023-07-16 01:11:06,604 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46827 2023-07-16 01:11:06,604 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46827 2023-07-16 01:11:06,604 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46827 2023-07-16 01:11:06,618 INFO [Listener at localhost/36899] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 01:11:06,618 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,619 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,619 INFO [Listener at localhost/36899] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 01:11:06,619 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,620 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 01:11:06,620 INFO [Listener at localhost/36899] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 01:11:06,621 INFO [Listener at localhost/36899] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38989 2023-07-16 01:11:06,622 INFO [Listener at localhost/36899] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 01:11:06,623 INFO [Listener at localhost/36899] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 01:11:06,624 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,635 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,638 INFO [Listener at localhost/36899] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38989 connecting to ZooKeeper ensemble=127.0.0.1:55425 2023-07-16 01:11:06,647 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:389890x0, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 01:11:06,648 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): regionserver:389890x0, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:11:06,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38989-0x1016baecab10002 connected 2023-07-16 01:11:06,651 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:11:06,652 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 01:11:06,657 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38989 2023-07-16 01:11:06,658 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38989 2023-07-16 01:11:06,658 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38989 2023-07-16 01:11:06,667 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38989 2023-07-16 01:11:06,668 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38989 2023-07-16 01:11:06,682 INFO [Listener at localhost/36899] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 01:11:06,682 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,682 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,683 INFO [Listener at localhost/36899] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 01:11:06,683 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,683 INFO [Listener at localhost/36899] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 01:11:06,683 INFO [Listener at localhost/36899] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 01:11:06,685 INFO [Listener at localhost/36899] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41771 2023-07-16 01:11:06,686 INFO [Listener at localhost/36899] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 01:11:06,688 INFO [Listener at localhost/36899] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 01:11:06,689 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,691 INFO [Listener at localhost/36899] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,692 INFO [Listener at localhost/36899] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41771 connecting to ZooKeeper ensemble=127.0.0.1:55425 2023-07-16 01:11:06,704 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:417710x0, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 01:11:06,705 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): regionserver:417710x0, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:11:06,707 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): regionserver:417710x0, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:11:06,708 DEBUG [Listener at localhost/36899] zookeeper.ZKUtil(164): regionserver:417710x0, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 01:11:06,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41771-0x1016baecab10003 connected 2023-07-16 01:11:06,717 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41771 2023-07-16 01:11:06,718 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41771 2023-07-16 01:11:06,723 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41771 2023-07-16 01:11:06,727 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41771 2023-07-16 01:11:06,731 DEBUG [Listener at localhost/36899] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41771 2023-07-16 01:11:06,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:11:06,751 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 01:11:06,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:11:06,777 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 01:11:06,777 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 01:11:06,777 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 01:11:06,777 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:06,778 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 01:11:06,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 01:11:06,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 01:11:06,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34911,1689469864893 from backup master directory 2023-07-16 01:11:06,788 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:11:06,788 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 01:11:06,789 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 01:11:06,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:11:06,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-16 01:11:06,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-16 01:11:06,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/hbase.id with ID: 1e781d43-592a-4318-abbb-7c03a9276be9 2023-07-16 01:11:06,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,990 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:07,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x74d5c593 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:07,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59e19aac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:07,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:07,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-16 01:11:07,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-16 01:11:07,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-16 01:11:07,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 01:11:07,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 01:11:07,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:07,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/data/master/store-tmp 2023-07-16 01:11:07,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:07,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 01:11:07,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:11:07,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:11:07,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 01:11:07,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:11:07,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:11:07,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 01:11:07,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/WALs/jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:11:07,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34911%2C1689469864893, suffix=, logDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/WALs/jenkins-hbase4.apache.org,34911,1689469864893, archiveDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/oldWALs, maxLogs=10 2023-07-16 01:11:07,426 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK] 2023-07-16 01:11:07,426 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK] 2023-07-16 01:11:07,426 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK] 2023-07-16 01:11:07,443 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-16 01:11:07,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/WALs/jenkins-hbase4.apache.org,34911,1689469864893/jenkins-hbase4.apache.org%2C34911%2C1689469864893.1689469867370 2023-07-16 01:11:07,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK], DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK], DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK]] 2023-07-16 01:11:07,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:11:07,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:07,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,622 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,629 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-16 01:11:07,657 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-16 01:11:07,672 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:07,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:07,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68716554, jitterRate=0.02395644783973694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:07,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 01:11:07,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-16 01:11:07,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-16 01:11:07,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-16 01:11:07,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-16 01:11:07,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-16 01:11:07,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-16 01:11:07,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-16 01:11:07,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-16 01:11:07,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-16 01:11:07,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-16 01:11:07,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-16 01:11:07,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-16 01:11:07,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-16 01:11:07,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-16 01:11:07,902 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:07,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-16 01:11:07,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-16 01:11:07,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-16 01:11:07,942 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 01:11:07,942 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 01:11:07,943 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 01:11:07,942 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 01:11:07,943 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:07,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34911,1689469864893, sessionid=0x1016baecab10000, setting cluster-up flag (Was=false) 2023-07-16 01:11:07,977 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:07,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-16 01:11:07,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:11:08,009 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:08,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-16 01:11:08,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:11:08,022 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp 2023-07-16 01:11:08,049 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(951): ClusterId : 1e781d43-592a-4318-abbb-7c03a9276be9 2023-07-16 01:11:08,049 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(951): ClusterId : 1e781d43-592a-4318-abbb-7c03a9276be9 2023-07-16 01:11:08,055 INFO [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(951): ClusterId : 1e781d43-592a-4318-abbb-7c03a9276be9 2023-07-16 01:11:08,058 DEBUG [RS:2;jenkins-hbase4:41771] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 01:11:08,058 DEBUG [RS:0;jenkins-hbase4:46827] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 01:11:08,058 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 01:11:08,066 DEBUG [RS:2;jenkins-hbase4:41771] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 01:11:08,066 DEBUG [RS:0;jenkins-hbase4:46827] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 01:11:08,067 DEBUG [RS:0;jenkins-hbase4:46827] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 01:11:08,066 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 01:11:08,067 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 01:11:08,066 DEBUG [RS:2;jenkins-hbase4:41771] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 01:11:08,072 DEBUG [RS:0;jenkins-hbase4:46827] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 01:11:08,074 DEBUG [RS:0;jenkins-hbase4:46827] zookeeper.ReadOnlyZKClient(139): Connect 0x6baef2c0 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:08,074 DEBUG [RS:2;jenkins-hbase4:41771] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 01:11:08,075 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 01:11:08,077 DEBUG [RS:2;jenkins-hbase4:41771] zookeeper.ReadOnlyZKClient(139): Connect 0x35112290 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:08,077 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ReadOnlyZKClient(139): Connect 0x020996c4 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:08,156 DEBUG [RS:0;jenkins-hbase4:46827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@656901c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:08,158 DEBUG [RS:0;jenkins-hbase4:46827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@615699b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 01:11:08,165 DEBUG [RS:2;jenkins-hbase4:41771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bd6da42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:08,169 DEBUG [RS:2;jenkins-hbase4:41771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fe949e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 01:11:08,175 DEBUG [RS:1;jenkins-hbase4:38989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cce78f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:08,175 DEBUG [RS:1;jenkins-hbase4:38989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8f1fdb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 01:11:08,200 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38989 2023-07-16 01:11:08,208 INFO [RS:1;jenkins-hbase4:38989] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 01:11:08,208 INFO [RS:1;jenkins-hbase4:38989] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 01:11:08,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-16 01:11:08,205 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41771 2023-07-16 01:11:08,215 INFO [RS:2;jenkins-hbase4:41771] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 01:11:08,217 INFO [RS:2;jenkins-hbase4:41771] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 01:11:08,219 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 01:11:08,220 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 01:11:08,221 INFO [RS:2;jenkins-hbase4:41771] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:08,221 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 01:11:08,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:08,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-16 01:11:08,241 INFO [RS:1;jenkins-hbase4:38989] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:08,241 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 01:11:08,245 INFO [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34911,1689469864893 with isa=jenkins-hbase4.apache.org/172.31.14.131:41771, startcode=1689469866681 2023-07-16 01:11:08,250 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34911,1689469864893 with isa=jenkins-hbase4.apache.org/172.31.14.131:38989, startcode=1689469866617 2023-07-16 01:11:08,251 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46827 2023-07-16 01:11:08,251 INFO [RS:0;jenkins-hbase4:46827] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 01:11:08,251 INFO [RS:0;jenkins-hbase4:46827] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 01:11:08,257 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 01:11:08,258 INFO [RS:0;jenkins-hbase4:46827] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:08,258 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 01:11:08,259 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34911,1689469864893 with isa=jenkins-hbase4.apache.org/172.31.14.131:46827, startcode=1689469866564 2023-07-16 01:11:08,275 DEBUG [RS:0;jenkins-hbase4:46827] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 01:11:08,275 DEBUG [RS:2;jenkins-hbase4:41771] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 01:11:08,277 DEBUG [RS:1;jenkins-hbase4:38989] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 01:11:08,385 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51271, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 01:11:08,389 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33703, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 01:11:08,389 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42775, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 01:11:08,397 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34911] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 01:11:08,411 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34911] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 01:11:08,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-16 01:11:08,416 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34911] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 01:11:08,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 01:11:08,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 01:11:08,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 01:11:08,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 01:11:08,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-16 01:11:08,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 01:11:08,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,437 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 01:11:08,437 WARN [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 01:11:08,438 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 01:11:08,438 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 01:11:08,438 WARN [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 01:11:08,438 WARN [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-16 01:11:08,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689469898448 2023-07-16 01:11:08,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-16 01:11:08,456 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 01:11:08,457 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-16 01:11:08,463 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:08,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-16 01:11:08,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-16 01:11:08,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-16 01:11:08,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-16 01:11:08,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-16 01:11:08,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-16 01:11:08,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-16 01:11:08,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-16 01:11:08,541 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34911,1689469864893 with isa=jenkins-hbase4.apache.org/172.31.14.131:38989, startcode=1689469866617 2023-07-16 01:11:08,542 INFO [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34911,1689469864893 with isa=jenkins-hbase4.apache.org/172.31.14.131:41771, startcode=1689469866681 2023-07-16 01:11:08,541 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34911,1689469864893 with isa=jenkins-hbase4.apache.org/172.31.14.131:46827, startcode=1689469866564 2023-07-16 01:11:08,553 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34911] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 01:11:08,554 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34911] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 01:11:08,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-16 01:11:08,556 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34911] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-16 01:11:08,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-16 01:11:08,559 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 01:11:08,559 WARN [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 200 ms and then retrying. 2023-07-16 01:11:08,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689469868559,5,FailOnTimeoutGroup] 2023-07-16 01:11:08,561 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 01:11:08,561 WARN [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 200 ms and then retrying. 2023-07-16 01:11:08,561 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(2830): Master is not running yet 2023-07-16 01:11:08,561 WARN [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 200 ms and then retrying. 2023-07-16 01:11:08,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689469868561,5,FailOnTimeoutGroup] 2023-07-16 01:11:08,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-16 01:11:08,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,595 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:08,596 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:08,596 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:08,656 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:08,663 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 01:11:08,668 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/info 2023-07-16 01:11:08,669 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 01:11:08,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:08,671 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 01:11:08,674 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/rep_barrier 2023-07-16 01:11:08,675 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 01:11:08,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:08,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 01:11:08,679 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/table 2023-07-16 01:11:08,680 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 01:11:08,681 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:08,683 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740 2023-07-16 01:11:08,684 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740 2023-07-16 01:11:08,689 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 01:11:08,691 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 01:11:08,695 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:08,696 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72569637, jitterRate=0.08137185871601105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 01:11:08,696 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 01:11:08,696 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 01:11:08,696 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 01:11:08,696 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 01:11:08,696 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 01:11:08,696 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 01:11:08,697 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 01:11:08,698 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 01:11:08,714 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 01:11:08,714 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-16 01:11:08,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-16 01:11:08,746 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-16 01:11:08,749 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-16 01:11:08,760 INFO [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34911,1689469864893 with isa=jenkins-hbase4.apache.org/172.31.14.131:41771, startcode=1689469866681 2023-07-16 01:11:08,762 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34911,1689469864893 with isa=jenkins-hbase4.apache.org/172.31.14.131:38989, startcode=1689469866617 2023-07-16 01:11:08,763 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34911,1689469864893 with isa=jenkins-hbase4.apache.org/172.31.14.131:46827, startcode=1689469866564 2023-07-16 01:11:08,768 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34911] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:08,775 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34911] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:08,777 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:08,777 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35755 2023-07-16 01:11:08,777 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 01:11:08,779 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:08,779 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35755 2023-07-16 01:11:08,779 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 01:11:08,781 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34911] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:08,782 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:08,782 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35755 2023-07-16 01:11:08,782 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 01:11:08,786 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:11:08,793 DEBUG [RS:2;jenkins-hbase4:41771] zookeeper.ZKUtil(162): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:08,793 WARN [RS:2;jenkins-hbase4:41771] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 01:11:08,793 INFO [RS:2;jenkins-hbase4:41771] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:08,793 DEBUG [RS:0;jenkins-hbase4:46827] zookeeper.ZKUtil(162): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:08,793 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ZKUtil(162): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:08,793 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:08,794 WARN [RS:1;jenkins-hbase4:38989] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 01:11:08,793 WARN [RS:0;jenkins-hbase4:46827] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 01:11:08,795 INFO [RS:0;jenkins-hbase4:46827] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:08,795 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:08,796 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41771,1689469866681] 2023-07-16 01:11:08,796 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38989,1689469866617] 2023-07-16 01:11:08,796 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46827,1689469866564] 2023-07-16 01:11:08,794 INFO [RS:1;jenkins-hbase4:38989] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:08,796 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:08,838 DEBUG [RS:2;jenkins-hbase4:41771] zookeeper.ZKUtil(162): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:08,839 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ZKUtil(162): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:08,839 DEBUG [RS:0;jenkins-hbase4:46827] zookeeper.ZKUtil(162): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:08,839 DEBUG [RS:2;jenkins-hbase4:41771] zookeeper.ZKUtil(162): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:08,839 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ZKUtil(162): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:08,839 DEBUG [RS:0;jenkins-hbase4:46827] zookeeper.ZKUtil(162): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:08,840 DEBUG [RS:2;jenkins-hbase4:41771] zookeeper.ZKUtil(162): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:08,840 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ZKUtil(162): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:08,840 DEBUG [RS:0;jenkins-hbase4:46827] zookeeper.ZKUtil(162): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:08,855 DEBUG [RS:2;jenkins-hbase4:41771] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 01:11:08,855 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 01:11:08,855 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 01:11:08,868 INFO [RS:2;jenkins-hbase4:41771] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 01:11:08,869 INFO [RS:0;jenkins-hbase4:46827] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 01:11:08,870 INFO [RS:1;jenkins-hbase4:38989] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 01:11:08,899 INFO [RS:1;jenkins-hbase4:38989] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 01:11:08,899 INFO [RS:0;jenkins-hbase4:46827] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 01:11:08,899 INFO [RS:2;jenkins-hbase4:41771] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 01:11:08,902 DEBUG [jenkins-hbase4:34911] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-16 01:11:08,907 DEBUG [jenkins-hbase4:34911] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:08,909 INFO [RS:1;jenkins-hbase4:38989] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 01:11:08,909 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,911 INFO [RS:0;jenkins-hbase4:46827] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 01:11:08,912 INFO [RS:0;jenkins-hbase4:46827] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,912 INFO [RS:2;jenkins-hbase4:41771] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 01:11:08,915 INFO [RS:2;jenkins-hbase4:41771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,915 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 01:11:08,915 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 01:11:08,915 INFO [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 01:11:08,922 DEBUG [jenkins-hbase4:34911] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:08,922 DEBUG [jenkins-hbase4:34911] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:08,922 DEBUG [jenkins-hbase4:34911] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:08,922 DEBUG [jenkins-hbase4:34911] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:08,925 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46827,1689469866564, state=OPENING 2023-07-16 01:11:08,927 INFO [RS:0;jenkins-hbase4:46827] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,927 INFO [RS:2;jenkins-hbase4:41771] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,927 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,927 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,928 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,928 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,928 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,929 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,929 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,929 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,929 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,929 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,929 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 01:11:08,929 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,929 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,929 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,929 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,930 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,930 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,930 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,930 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 01:11:08,930 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,930 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,931 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,931 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,929 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 01:11:08,929 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,931 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,931 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,931 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,931 DEBUG [RS:2;jenkins-hbase4:41771] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,935 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,939 INFO [RS:2;jenkins-hbase4:41771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,935 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,941 INFO [RS:2;jenkins-hbase4:41771] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,941 DEBUG [RS:0;jenkins-hbase4:46827] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,941 INFO [RS:2;jenkins-hbase4:41771] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,941 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,941 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,944 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-16 01:11:08,947 INFO [RS:0;jenkins-hbase4:46827] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,947 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:08,947 INFO [RS:0;jenkins-hbase4:46827] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,948 INFO [RS:0;jenkins-hbase4:46827] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,948 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 01:11:08,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46827,1689469866564}] 2023-07-16 01:11:08,966 INFO [RS:1;jenkins-hbase4:38989] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 01:11:08,968 INFO [RS:0;jenkins-hbase4:46827] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 01:11:08,969 INFO [RS:2;jenkins-hbase4:41771] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 01:11:08,970 INFO [RS:2;jenkins-hbase4:41771] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41771,1689469866681-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,970 INFO [RS:0;jenkins-hbase4:46827] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46827,1689469866564-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,970 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38989,1689469866617-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,999 INFO [RS:2;jenkins-hbase4:41771] regionserver.Replication(203): jenkins-hbase4.apache.org,41771,1689469866681 started 2023-07-16 01:11:08,999 INFO [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41771,1689469866681, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41771, sessionid=0x1016baecab10003 2023-07-16 01:11:08,999 INFO [RS:0;jenkins-hbase4:46827] regionserver.Replication(203): jenkins-hbase4.apache.org,46827,1689469866564 started 2023-07-16 01:11:08,999 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46827,1689469866564, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46827, sessionid=0x1016baecab10001 2023-07-16 01:11:09,000 DEBUG [RS:2;jenkins-hbase4:41771] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 01:11:09,000 DEBUG [RS:0;jenkins-hbase4:46827] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 01:11:09,000 DEBUG [RS:2;jenkins-hbase4:41771] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:09,000 DEBUG [RS:0;jenkins-hbase4:46827] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:09,003 DEBUG [RS:2;jenkins-hbase4:41771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41771,1689469866681' 2023-07-16 01:11:09,003 DEBUG [RS:0;jenkins-hbase4:46827] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46827,1689469866564' 2023-07-16 01:11:09,004 DEBUG [RS:2;jenkins-hbase4:41771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 01:11:09,004 DEBUG [RS:0;jenkins-hbase4:46827] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 01:11:09,005 DEBUG [RS:2;jenkins-hbase4:41771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 01:11:09,005 DEBUG [RS:0;jenkins-hbase4:46827] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 01:11:09,006 DEBUG [RS:2;jenkins-hbase4:41771] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 01:11:09,006 DEBUG [RS:2;jenkins-hbase4:41771] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 01:11:09,006 DEBUG [RS:2;jenkins-hbase4:41771] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:09,006 DEBUG [RS:2;jenkins-hbase4:41771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41771,1689469866681' 2023-07-16 01:11:09,006 DEBUG [RS:2;jenkins-hbase4:41771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:09,006 DEBUG [RS:0;jenkins-hbase4:46827] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 01:11:09,006 DEBUG [RS:0;jenkins-hbase4:46827] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 01:11:09,006 DEBUG [RS:0;jenkins-hbase4:46827] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:09,007 DEBUG [RS:0;jenkins-hbase4:46827] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46827,1689469866564' 2023-07-16 01:11:09,007 DEBUG [RS:0;jenkins-hbase4:46827] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:09,007 DEBUG [RS:2;jenkins-hbase4:41771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:09,007 DEBUG [RS:0;jenkins-hbase4:46827] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:09,008 DEBUG [RS:2;jenkins-hbase4:41771] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 01:11:09,008 INFO [RS:2;jenkins-hbase4:41771] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 01:11:09,008 DEBUG [RS:0;jenkins-hbase4:46827] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 01:11:09,008 INFO [RS:2;jenkins-hbase4:41771] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 01:11:09,008 INFO [RS:0;jenkins-hbase4:46827] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 01:11:09,009 INFO [RS:0;jenkins-hbase4:46827] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 01:11:09,014 INFO [RS:1;jenkins-hbase4:38989] regionserver.Replication(203): jenkins-hbase4.apache.org,38989,1689469866617 started 2023-07-16 01:11:09,015 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38989,1689469866617, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38989, sessionid=0x1016baecab10002 2023-07-16 01:11:09,015 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 01:11:09,015 DEBUG [RS:1;jenkins-hbase4:38989] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:09,015 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38989,1689469866617' 2023-07-16 01:11:09,015 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 01:11:09,015 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 01:11:09,016 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 01:11:09,016 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 01:11:09,016 DEBUG [RS:1;jenkins-hbase4:38989] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:09,016 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38989,1689469866617' 2023-07-16 01:11:09,016 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:09,017 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:09,017 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 01:11:09,017 INFO [RS:1;jenkins-hbase4:38989] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 01:11:09,018 INFO [RS:1;jenkins-hbase4:38989] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 01:11:09,120 INFO [RS:0;jenkins-hbase4:46827] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46827%2C1689469866564, suffix=, logDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,46827,1689469866564, archiveDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/oldWALs, maxLogs=32 2023-07-16 01:11:09,120 INFO [RS:2;jenkins-hbase4:41771] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41771%2C1689469866681, suffix=, logDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,41771,1689469866681, archiveDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/oldWALs, maxLogs=32 2023-07-16 01:11:09,121 INFO [RS:1;jenkins-hbase4:38989] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38989%2C1689469866617, suffix=, logDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,38989,1689469866617, archiveDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/oldWALs, maxLogs=32 2023-07-16 01:11:09,189 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK] 2023-07-16 01:11:09,189 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK] 2023-07-16 01:11:09,190 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:09,199 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK] 2023-07-16 01:11:09,200 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK] 2023-07-16 01:11:09,201 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:11:09,202 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK] 2023-07-16 01:11:09,203 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK] 2023-07-16 01:11:09,211 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK] 2023-07-16 01:11:09,211 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK] 2023-07-16 01:11:09,211 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK] 2023-07-16 01:11:09,227 INFO [RS:0;jenkins-hbase4:46827] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,46827,1689469866564/jenkins-hbase4.apache.org%2C46827%2C1689469866564.1689469869126 2023-07-16 01:11:09,227 INFO [RS:2;jenkins-hbase4:41771] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,41771,1689469866681/jenkins-hbase4.apache.org%2C41771%2C1689469866681.1689469869126 2023-07-16 01:11:09,228 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:11:09,231 DEBUG [RS:0;jenkins-hbase4:46827] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK], DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK], DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK]] 2023-07-16 01:11:09,231 INFO [RS:1;jenkins-hbase4:38989] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,38989,1689469866617/jenkins-hbase4.apache.org%2C38989%2C1689469866617.1689469869127 2023-07-16 01:11:09,231 DEBUG [RS:2;jenkins-hbase4:41771] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK], DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK], DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK]] 2023-07-16 01:11:09,242 DEBUG [RS:1;jenkins-hbase4:38989] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK], DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK], DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK]] 2023-07-16 01:11:09,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-16 01:11:09,267 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:09,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46827%2C1689469866564.meta, suffix=.meta, logDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,46827,1689469866564, archiveDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/oldWALs, maxLogs=32 2023-07-16 01:11:09,298 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK] 2023-07-16 01:11:09,298 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK] 2023-07-16 01:11:09,305 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK] 2023-07-16 01:11:09,321 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/WALs/jenkins-hbase4.apache.org,46827,1689469866564/jenkins-hbase4.apache.org%2C46827%2C1689469866564.meta.1689469869273.meta 2023-07-16 01:11:09,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46855,DS-6f4026e2-c067-432e-8f03-d6c1b3aa61fc,DISK], DatanodeInfoWithStorage[127.0.0.1:46273,DS-2e99c1a8-8f37-4dec-bf09-fd363d84bbd3,DISK], DatanodeInfoWithStorage[127.0.0.1:42767,DS-69b01bf6-0dab-4a84-9fb9-557ea3064e63,DISK]] 2023-07-16 01:11:09,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:11:09,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-16 01:11:09,326 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:09,327 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-16 01:11:09,329 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-16 01:11:09,331 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-16 01:11:09,344 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-16 01:11:09,344 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:09,344 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-16 01:11:09,344 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-16 01:11:09,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 01:11:09,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/info 2023-07-16 01:11:09,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/info 2023-07-16 01:11:09,353 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 01:11:09,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:09,356 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 01:11:09,358 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/rep_barrier 2023-07-16 01:11:09,358 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/rep_barrier 2023-07-16 01:11:09,359 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 01:11:09,360 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:09,360 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 01:11:09,362 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/table 2023-07-16 01:11:09,362 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/table 2023-07-16 01:11:09,363 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 01:11:09,364 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:09,366 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740 2023-07-16 01:11:09,370 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740 2023-07-16 01:11:09,375 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 01:11:09,378 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 01:11:09,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61540470, jitterRate=-0.08297553658485413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 01:11:09,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 01:11:09,400 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689469869179 2023-07-16 01:11:09,419 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-16 01:11:09,420 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-16 01:11:09,421 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46827,1689469866564, state=OPEN 2023-07-16 01:11:09,424 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-16 01:11:09,424 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 01:11:09,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-16 01:11:09,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46827,1689469866564 in 470 msec 2023-07-16 01:11:09,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-16 01:11:09,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 708 msec 2023-07-16 01:11:09,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2150 sec 2023-07-16 01:11:09,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689469869463, completionTime=-1 2023-07-16 01:11:09,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-16 01:11:09,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-16 01:11:09,553 DEBUG [hconnection-0x7c9ebafe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:09,556 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:09,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-16 01:11:09,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689469929578 2023-07-16 01:11:09,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689469989578 2023-07-16 01:11:09,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 114 msec 2023-07-16 01:11:09,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34911,1689469864893-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34911,1689469864893-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34911,1689469864893-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34911, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,620 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-16 01:11:09,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-16 01:11:09,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:09,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-16 01:11:09,647 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:09,650 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:09,673 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:11:09,676 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e empty. 2023-07-16 01:11:09,677 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:11:09,677 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-16 01:11:09,726 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:09,728 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8583216abc1d3c0b01a3ef4ff4308c8e, NAME => 'hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:11:09,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:09,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8583216abc1d3c0b01a3ef4ff4308c8e, disabling compactions & flushes 2023-07-16 01:11:09,757 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:11:09,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:11:09,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. after waiting 0 ms 2023-07-16 01:11:09,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:11:09,757 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:11:09,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8583216abc1d3c0b01a3ef4ff4308c8e: 2023-07-16 01:11:09,763 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:09,782 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689469869769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469869769"}]},"ts":"1689469869769"} 2023-07-16 01:11:09,815 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 01:11:09,817 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:09,822 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469869818"}]},"ts":"1689469869818"} 2023-07-16 01:11:09,827 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-16 01:11:09,832 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:09,833 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:09,833 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:09,833 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:09,833 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:09,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8583216abc1d3c0b01a3ef4ff4308c8e, ASSIGN}] 2023-07-16 01:11:09,841 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8583216abc1d3c0b01a3ef4ff4308c8e, ASSIGN 2023-07-16 01:11:09,843 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8583216abc1d3c0b01a3ef4ff4308c8e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1689469866617; forceNewPlan=false, retain=false 2023-07-16 01:11:09,996 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 01:11:09,997 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8583216abc1d3c0b01a3ef4ff4308c8e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:09,997 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689469869997"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469869997"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469869997"}]},"ts":"1689469869997"} 2023-07-16 01:11:10,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8583216abc1d3c0b01a3ef4ff4308c8e, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:11:10,161 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:10,162 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:11:10,166 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:11:10,173 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:11:10,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8583216abc1d3c0b01a3ef4ff4308c8e, NAME => 'hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e.', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:11:10,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. service=AccessControlService 2023-07-16 01:11:10,174 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:10,175 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:11:10,175 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:10,175 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:11:10,175 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:11:10,178 INFO [StoreOpener-8583216abc1d3c0b01a3ef4ff4308c8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:11:10,181 DEBUG [StoreOpener-8583216abc1d3c0b01a3ef4ff4308c8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e/info 2023-07-16 01:11:10,181 DEBUG [StoreOpener-8583216abc1d3c0b01a3ef4ff4308c8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e/info 2023-07-16 01:11:10,182 INFO [StoreOpener-8583216abc1d3c0b01a3ef4ff4308c8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8583216abc1d3c0b01a3ef4ff4308c8e columnFamilyName info 2023-07-16 01:11:10,184 INFO [StoreOpener-8583216abc1d3c0b01a3ef4ff4308c8e-1] regionserver.HStore(310): Store=8583216abc1d3c0b01a3ef4ff4308c8e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:10,186 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:11:10,187 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:11:10,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:11:10,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:10,200 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8583216abc1d3c0b01a3ef4ff4308c8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62347439, jitterRate=-0.07095076143741608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:10,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8583216abc1d3c0b01a3ef4ff4308c8e: 2023-07-16 01:11:10,203 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e., pid=6, masterSystemTime=1689469870161 2023-07-16 01:11:10,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:11:10,209 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:11:10,211 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8583216abc1d3c0b01a3ef4ff4308c8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:10,212 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689469870210"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469870210"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469870210"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469870210"}]},"ts":"1689469870210"} 2023-07-16 01:11:10,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-16 01:11:10,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8583216abc1d3c0b01a3ef4ff4308c8e, server=jenkins-hbase4.apache.org,38989,1689469866617 in 210 msec 2023-07-16 01:11:10,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-16 01:11:10,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8583216abc1d3c0b01a3ef4ff4308c8e, ASSIGN in 383 msec 2023-07-16 01:11:10,226 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:10,227 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469870227"}]},"ts":"1689469870227"} 2023-07-16 01:11:10,230 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-16 01:11:10,235 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:10,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 601 msec 2023-07-16 01:11:10,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-16 01:11:10,249 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-16 01:11:10,249 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:10,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:10,275 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:10,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-16 01:11:10,316 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 01:11:10,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-07-16 01:11:10,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-16 01:11:10,351 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 01:11:10,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-07-16 01:11:10,373 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-16 01:11:10,376 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-16 01:11:10,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.587sec 2023-07-16 01:11:10,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-16 01:11:10,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-16 01:11:10,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-16 01:11:10,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34911,1689469864893-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-16 01:11:10,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34911,1689469864893-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-16 01:11:10,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:10,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-16 01:11:10,418 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:10,421 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:10,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-16 01:11:10,425 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:11:10,427 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f empty. 2023-07-16 01:11:10,430 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:11:10,430 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-16 01:11:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 01:11:10,471 DEBUG [Listener at localhost/36899] zookeeper.ReadOnlyZKClient(139): Connect 0x14cf5ca5 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:10,505 DEBUG [Listener at localhost/36899] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cb5649c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:10,510 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:10,514 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => fdeef80e2b3d835002e0e8cc9f27c92f, NAME => 'hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:11:10,536 DEBUG [hconnection-0x399bf560-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:10,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 01:11:10,558 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:10,558 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing fdeef80e2b3d835002e0e8cc9f27c92f, disabling compactions & flushes 2023-07-16 01:11:10,558 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:11:10,558 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:11:10,558 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. after waiting 0 ms 2023-07-16 01:11:10,558 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:11:10,558 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:11:10,559 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for fdeef80e2b3d835002e0e8cc9f27c92f: 2023-07-16 01:11:10,562 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:10,565 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:11:10,565 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-16 01:11:10,565 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/test.cache.data in system properties and HBase conf 2023-07-16 01:11:10,565 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 01:11:10,565 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop.log.dir in system properties and HBase conf 2023-07-16 01:11:10,565 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 01:11:10,565 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 01:11:10,565 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 01:11:10,565 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/nfs.dump.dir in system properties and HBase conf 2023-07-16 01:11:10,566 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir in system properties and HBase conf 2023-07-16 01:11:10,567 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 01:11:10,567 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 01:11:10,567 INFO [Listener at localhost/36899] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-16 01:11:10,567 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689469870567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469870567"}]},"ts":"1689469870567"} 2023-07-16 01:11:10,570 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 01:11:10,573 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:10,573 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469870573"}]},"ts":"1689469870573"} 2023-07-16 01:11:10,575 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-16 01:11:10,581 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:10,582 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:10,582 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:10,582 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:10,582 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:10,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=fdeef80e2b3d835002e0e8cc9f27c92f, ASSIGN}] 2023-07-16 01:11:10,585 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=fdeef80e2b3d835002e0e8cc9f27c92f, ASSIGN 2023-07-16 01:11:10,587 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=fdeef80e2b3d835002e0e8cc9f27c92f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1689469866617; forceNewPlan=false, retain=false 2023-07-16 01:11:10,737 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 01:11:10,739 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fdeef80e2b3d835002e0e8cc9f27c92f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:10,739 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689469870739"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469870739"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469870739"}]},"ts":"1689469870739"} 2023-07-16 01:11:10,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 01:11:10,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure fdeef80e2b3d835002e0e8cc9f27c92f, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:11:10,904 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:11:10,904 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fdeef80e2b3d835002e0e8cc9f27c92f, NAME => 'hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f.', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:11:10,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. service=AccessControlService 2023-07-16 01:11:10,905 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:10,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:11:10,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:10,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:11:10,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:11:10,911 INFO [StoreOpener-fdeef80e2b3d835002e0e8cc9f27c92f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:11:10,914 DEBUG [StoreOpener-fdeef80e2b3d835002e0e8cc9f27c92f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f/l 2023-07-16 01:11:10,914 DEBUG [StoreOpener-fdeef80e2b3d835002e0e8cc9f27c92f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f/l 2023-07-16 01:11:10,915 INFO [StoreOpener-fdeef80e2b3d835002e0e8cc9f27c92f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdeef80e2b3d835002e0e8cc9f27c92f columnFamilyName l 2023-07-16 01:11:10,916 INFO [StoreOpener-fdeef80e2b3d835002e0e8cc9f27c92f-1] regionserver.HStore(310): Store=fdeef80e2b3d835002e0e8cc9f27c92f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:10,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:11:10,920 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:11:10,925 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:11:10,956 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:10,957 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fdeef80e2b3d835002e0e8cc9f27c92f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66037731, jitterRate=-0.01596112549304962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:10,958 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fdeef80e2b3d835002e0e8cc9f27c92f: 2023-07-16 01:11:10,959 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f., pid=11, masterSystemTime=1689469870898 2023-07-16 01:11:10,964 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:11:10,964 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:11:10,966 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fdeef80e2b3d835002e0e8cc9f27c92f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:10,966 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689469870965"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469870965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469870965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469870965"}]},"ts":"1689469870965"} 2023-07-16 01:11:10,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-16 01:11:10,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure fdeef80e2b3d835002e0e8cc9f27c92f, server=jenkins-hbase4.apache.org,38989,1689469866617 in 227 msec 2023-07-16 01:11:10,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-16 01:11:10,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=fdeef80e2b3d835002e0e8cc9f27c92f, ASSIGN in 395 msec 2023-07-16 01:11:10,986 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:10,987 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469870986"}]},"ts":"1689469870986"} 2023-07-16 01:11:10,996 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-16 01:11:11,001 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:11,005 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 589 msec 2023-07-16 01:11:11,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 01:11:11,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-16 01:11:11,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-16 01:11:12,065 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:12,471 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:12,478 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36623_jobhistory____ikmevx/webapp 2023-07-16 01:11:12,642 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-16 01:11:12,642 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-16 01:11:12,643 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 01:11:12,647 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 01:11:12,738 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:13,138 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:13,585 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-16 01:11:13,641 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36623 2023-07-16 01:11:14,912 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:11:15,194 WARN [Listener at jenkins-hbase4.apache.org/33217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:15,231 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-16 01:11:15,233 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-16 01:11:15,234 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-16 01:11:15,235 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:15,236 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-16 01:11:15,236 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:15,236 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-16 01:11:15,237 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 01:11:15,237 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-16 01:11:15,237 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:15,237 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-16 01:11:15,237 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 01:11:15,237 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-16 01:11:15,292 WARN [Listener at jenkins-hbase4.apache.org/33217] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 01:11:15,293 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:15,303 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35135_cluster____go7kur/webapp 2023-07-16 01:11:15,373 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 01:11:15,373 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-16 01:11:15,373 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 01:11:15,374 INFO [Listener at jenkins-hbase4.apache.org/33217] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 01:11:15,382 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:15,605 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:15,731 INFO [Listener at jenkins-hbase4.apache.org/33217] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:15,741 INFO [Listener at jenkins-hbase4.apache.org/33217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35135 2023-07-16 01:11:16,225 WARN [Listener at jenkins-hbase4.apache.org/36451] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:16,253 WARN [Listener at jenkins-hbase4.apache.org/36451] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 01:11:16,254 INFO [Listener at jenkins-hbase4.apache.org/36451] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:16,262 INFO [Listener at jenkins-hbase4.apache.org/36451] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46781_node____8tt9m4/webapp 2023-07-16 01:11:16,332 INFO [Listener at jenkins-hbase4.apache.org/36451] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 01:11:16,332 INFO [Listener at jenkins-hbase4.apache.org/36451] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 01:11:16,332 INFO [Listener at jenkins-hbase4.apache.org/36451] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 01:11:16,333 INFO [Listener at jenkins-hbase4.apache.org/36451] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 01:11:16,342 INFO [Listener at jenkins-hbase4.apache.org/36451] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:16,366 INFO [Listener at jenkins-hbase4.apache.org/36451] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:16,480 INFO [Listener at jenkins-hbase4.apache.org/36451] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:16,530 INFO [Listener at jenkins-hbase4.apache.org/36451] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46781 2023-07-16 01:11:16,794 WARN [Listener at jenkins-hbase4.apache.org/32773] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:16,805 WARN [Listener at jenkins-hbase4.apache.org/32773] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 01:11:16,806 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:16,823 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40785_node____iih586/webapp 2023-07-16 01:11:16,887 INFO [Listener at jenkins-hbase4.apache.org/32773] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 01:11:16,887 INFO [Listener at jenkins-hbase4.apache.org/32773] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 01:11:16,888 INFO [Listener at jenkins-hbase4.apache.org/32773] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 01:11:16,888 INFO [Listener at jenkins-hbase4.apache.org/32773] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 01:11:16,898 INFO [Listener at jenkins-hbase4.apache.org/32773] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:16,919 INFO [Listener at jenkins-hbase4.apache.org/32773] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:17,013 INFO [Listener at jenkins-hbase4.apache.org/32773] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:17,051 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40785 2023-07-16 01:11:17,123 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-16 01:11:17,124 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:17,216 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=290, ProcessCount=175, AvailableMemoryMB=4743 2023-07-16 01:11:17,216 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-16 01:11:17,233 DEBUG [Listener at jenkins-hbase4.apache.org/32773] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-16 01:11:17,239 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-16 01:11:17,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 01:11:17,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:17,253 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:17,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-16 01:11:17,256 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:17,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:17,263 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:17,263 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:17,265 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19 empty. 2023-07-16 01:11:17,265 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375 empty. 2023-07-16 01:11:17,266 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:17,266 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:17,266 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 01:11:17,298 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:17,300 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 50a6795e4743890c7141fa49ddcaee19, NAME => 'testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:11:17,300 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e0baf27bb2b1577c4bd87356c4492375, NAME => 'testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:11:17,340 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:17,340 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e0baf27bb2b1577c4bd87356c4492375, disabling compactions & flushes 2023-07-16 01:11:17,341 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:17,341 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:17,341 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. after waiting 0 ms 2023-07-16 01:11:17,341 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:17,341 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:17,341 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e0baf27bb2b1577c4bd87356c4492375: 2023-07-16 01:11:17,342 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:17,343 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 50a6795e4743890c7141fa49ddcaee19, disabling compactions & flushes 2023-07-16 01:11:17,343 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:17,343 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:17,343 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. after waiting 0 ms 2023-07-16 01:11:17,343 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:17,343 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:17,343 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 50a6795e4743890c7141fa49ddcaee19: 2023-07-16 01:11:17,351 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:17,353 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877353"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469877353"}]},"ts":"1689469877353"} 2023-07-16 01:11:17,353 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877353"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469877353"}]},"ts":"1689469877353"} 2023-07-16 01:11:17,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:17,405 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:11:17,407 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:17,407 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469877407"}]},"ts":"1689469877407"} 2023-07-16 01:11:17,409 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-16 01:11:17,414 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:17,415 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:17,415 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:17,415 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:17,416 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:17,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e0baf27bb2b1577c4bd87356c4492375, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=50a6795e4743890c7141fa49ddcaee19, ASSIGN}] 2023-07-16 01:11:17,419 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e0baf27bb2b1577c4bd87356c4492375, ASSIGN 2023-07-16 01:11:17,419 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=50a6795e4743890c7141fa49ddcaee19, ASSIGN 2023-07-16 01:11:17,420 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e0baf27bb2b1577c4bd87356c4492375, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41771,1689469866681; forceNewPlan=false, retain=false 2023-07-16 01:11:17,420 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=50a6795e4743890c7141fa49ddcaee19, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46827,1689469866564; forceNewPlan=false, retain=false 2023-07-16 01:11:17,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:17,570 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:11:17,573 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=50a6795e4743890c7141fa49ddcaee19, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:17,573 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e0baf27bb2b1577c4bd87356c4492375, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:17,573 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469877573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469877573"}]},"ts":"1689469877573"} 2023-07-16 01:11:17,573 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469877573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469877573"}]},"ts":"1689469877573"} 2023-07-16 01:11:17,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 50a6795e4743890c7141fa49ddcaee19, server=jenkins-hbase4.apache.org,46827,1689469866564}] 2023-07-16 01:11:17,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure e0baf27bb2b1577c4bd87356c4492375, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:11:17,733 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:17,733 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:11:17,736 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:11:17,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:17,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50a6795e4743890c7141fa49ddcaee19, NAME => 'testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:11:17,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. service=AccessControlService 2023-07-16 01:11:17,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:17,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:17,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:17,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:17,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:17,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:17,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0baf27bb2b1577c4bd87356c4492375, NAME => 'testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:11:17,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. service=AccessControlService 2023-07-16 01:11:17,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:17,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:17,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:17,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:17,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:17,752 INFO [StoreOpener-50a6795e4743890c7141fa49ddcaee19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:17,757 DEBUG [StoreOpener-50a6795e4743890c7141fa49ddcaee19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/cf 2023-07-16 01:11:17,757 DEBUG [StoreOpener-50a6795e4743890c7141fa49ddcaee19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/cf 2023-07-16 01:11:17,759 INFO [StoreOpener-e0baf27bb2b1577c4bd87356c4492375-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:17,761 DEBUG [StoreOpener-e0baf27bb2b1577c4bd87356c4492375-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/cf 2023-07-16 01:11:17,761 DEBUG [StoreOpener-e0baf27bb2b1577c4bd87356c4492375-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/cf 2023-07-16 01:11:17,763 INFO [StoreOpener-e0baf27bb2b1577c4bd87356c4492375-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0baf27bb2b1577c4bd87356c4492375 columnFamilyName cf 2023-07-16 01:11:17,763 INFO [StoreOpener-50a6795e4743890c7141fa49ddcaee19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50a6795e4743890c7141fa49ddcaee19 columnFamilyName cf 2023-07-16 01:11:17,766 INFO [StoreOpener-50a6795e4743890c7141fa49ddcaee19-1] regionserver.HStore(310): Store=50a6795e4743890c7141fa49ddcaee19/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:17,766 INFO [StoreOpener-e0baf27bb2b1577c4bd87356c4492375-1] regionserver.HStore(310): Store=e0baf27bb2b1577c4bd87356c4492375/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:17,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:17,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:17,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:17,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:17,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:17,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:17,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:17,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e0baf27bb2b1577c4bd87356c4492375; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61520632, jitterRate=-0.08327114582061768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:17,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e0baf27bb2b1577c4bd87356c4492375: 2023-07-16 01:11:17,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:17,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375., pid=16, masterSystemTime=1689469877733 2023-07-16 01:11:17,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 50a6795e4743890c7141fa49ddcaee19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66738623, jitterRate=-0.00551702082157135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:17,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 50a6795e4743890c7141fa49ddcaee19: 2023-07-16 01:11:17,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19., pid=15, masterSystemTime=1689469877729 2023-07-16 01:11:17,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:17,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:17,814 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e0baf27bb2b1577c4bd87356c4492375, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:17,814 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877814"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469877814"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469877814"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469877814"}]},"ts":"1689469877814"} 2023-07-16 01:11:17,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:17,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:17,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=50a6795e4743890c7141fa49ddcaee19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:17,818 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877816"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469877816"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469877816"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469877816"}]},"ts":"1689469877816"} 2023-07-16 01:11:17,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-16 01:11:17,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure e0baf27bb2b1577c4bd87356c4492375, server=jenkins-hbase4.apache.org,41771,1689469866681 in 241 msec 2023-07-16 01:11:17,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-16 01:11:17,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 50a6795e4743890c7141fa49ddcaee19, server=jenkins-hbase4.apache.org,46827,1689469866564 in 245 msec 2023-07-16 01:11:17,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e0baf27bb2b1577c4bd87356c4492375, ASSIGN in 407 msec 2023-07-16 01:11:17,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-16 01:11:17,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=50a6795e4743890c7141fa49ddcaee19, ASSIGN in 411 msec 2023-07-16 01:11:17,836 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:17,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469877836"}]},"ts":"1689469877836"} 2023-07-16 01:11:17,839 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-16 01:11:17,843 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:17,851 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-16 01:11:17,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:17,875 DEBUG [hconnection-0x1f9b0249-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:17,879 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-16 01:11:17,890 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 01:11:17,931 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:17,931 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:17,931 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:17,931 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:17,931 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:17,943 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:17,943 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:17,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:17,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:17,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:17,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:17,947 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 696 msec 2023-07-16 01:11:18,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:18,364 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-16 01:11:18,369 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 01:11:18,370 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:18,373 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:18,400 DEBUG [hconnection-0x399bf560-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:18,406 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:18,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:18,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469878424 (current time:1689469878424). 2023-07-16 01:11:18,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:18,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x13e8bde7 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:18,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18fef5b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:18,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:18,436 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:18,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13e8bde7 to 127.0.0.1:55425 2023-07-16 01:11:18,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:18,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x726020fd to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:18,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c0688e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:18,457 DEBUG [hconnection-0x3b586cea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:18,458 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:18,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:18,465 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:18,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x726020fd to 127.0.0.1:55425 2023-07-16 01:11:18,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:18,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 01:11:18,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:18,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:18,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:18,527 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:18,534 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689470478534 2023-07-16 01:11:18,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:18,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 01:11:18,538 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:18,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:18,544 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:18,544 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:18,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 24 msec 2023-07-16 01:11:18,550 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:18,551 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689470478551 2023-07-16 01:11:18,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,591 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-16 01:11:18,591 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:18,592 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 01:11:18,592 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 01:11:18,593 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,593 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,600 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:18,600 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:18,600 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:18,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:18,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:18,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:18,601 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:18,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:18,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:18,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:18,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,602 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:18,602 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:18,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,603 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:18,603 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:18,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 01:11:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 01:11:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,605 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:18,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:18,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 01:11:18,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:18,610 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,610 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,610 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,611 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:18,611 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:18,611 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:18,611 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:18,613 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:18,613 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:18,613 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:18,613 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:18,628 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:18,628 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:18,628 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:18,613 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:18,628 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:18,628 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:18,628 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:18,631 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:18,631 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:18,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:18,631 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,631 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:18,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:18,632 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,632 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,632 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:18,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:18,632 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,633 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:18,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:18,633 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,633 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:18,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:18,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:18,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 01:11:18,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e444752[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:18,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:18,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:18,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:18,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:18,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:18,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:18,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:18,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:18,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:18,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 01:11:18,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e444752[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:18,643 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 01:11:18,643 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,644 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:18,647 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,647 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,647 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,648 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:18,648 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:18,648 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:18,648 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:18,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:18,648 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:11:18,648 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:18,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:18,651 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:18,653 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:18,653 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:18,654 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:18,655 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:18,655 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:18,656 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:18,656 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:18,655 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:18,655 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:18,656 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:18,656 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. started... 2023-07-16 01:11:18,657 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:18,658 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. started... 2023-07-16 01:11:18,660 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0baf27bb2b1577c4bd87356c4492375: 2023-07-16 01:11:18,662 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,664 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50a6795e4743890c7141fa49ddcaee19: 2023-07-16 01:11:18,664 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,669 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:18,669 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:18,673 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:18,674 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:18,851 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:18,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:18,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:18,853 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:11:19,143 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. completed. 2023-07-16 01:11:19,143 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:19,144 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:19,144 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:19,144 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,144 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:19,144 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:11:19,146 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:19,146 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,146 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:19,146 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:19,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,149 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. completed. 2023-07-16 01:11:19,149 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:19,149 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:19,149 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:19,149 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,149 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:19,149 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:11:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,151 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,151 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:19,151 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,153 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:19,151 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:19,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:19,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:19,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,155 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 01:11:19,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41771,1689469866681': 2023-07-16 01:11:19,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 01:11:19,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46827,1689469866564': 2023-07-16 01:11:19,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 01:11:19,165 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-16 01:11:19,165 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:19,165 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:19,165 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,165 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:19,174 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,174 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,174 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,175 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,176 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,177 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,180 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,181 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,181 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,199 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,199 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,199 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,200 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,200 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,200 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-16 01:11:19,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:11:19,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,200 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,201 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,202 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,202 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,202 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,202 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,202 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,202 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,202 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,202 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,200 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:19,200 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 01:11:19,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,344 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 01:11:19,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,345 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:19,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689469878535Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689469879235 (+700 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689469879236 (+1 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689469879236Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689469879254 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689469879279 (+25 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689469879344 (+65 ms) 2023-07-16 01:11:19,348 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:19,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 811 msec 2023-07-16 01:11:19,655 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:19,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:19,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:19,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41771] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:19,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46827] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:19,680 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 01:11:19,681 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:19,681 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:19,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:19,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469879697 (current time:1689469879697). 2023-07-16 01:11:19,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:19,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x4b341f74 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:19,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3163b34c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:19,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:19,709 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:19,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b341f74 to 127.0.0.1:55425 2023-07-16 01:11:19,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:19,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x6015c075 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:19,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bb1acbc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:19,719 DEBUG [hconnection-0x27e49755-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:19,722 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:19,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:19,731 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:19,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6015c075 to 127.0.0.1:55425 2023-07-16 01:11:19,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:19,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 01:11:19,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:19,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:19,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:19,738 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:19,739 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689470479739 2023-07-16 01:11:19,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 01:11:19,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:19,741 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:19,741 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:19,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:19,743 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:19,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-16 01:11:19,746 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:19,747 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689470479747 2023-07-16 01:11:19,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-16 01:11:19,781 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-16 01:11:19,781 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:19,783 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 01:11:19,783 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 01:11:19,837 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,837 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,838 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,838 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,838 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,838 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,839 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,839 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,840 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,840 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:19,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:19,841 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,842 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:19,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 01:11:19,842 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:19,842 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:19,843 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:19,843 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:19,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 01:11:19,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 01:11:19,844 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:19,844 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:19,843 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:19,844 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:19,844 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:19,845 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:19,845 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:19,847 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:19,847 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:19,847 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:19,847 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:19,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:19,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:19,849 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:19,850 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,850 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,851 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,852 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,852 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,852 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,852 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:19,852 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,852 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:19,852 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,852 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 01:11:19,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@232d9bfe[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 01:11:19,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@232d9bfe[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:19,865 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 01:11:19,865 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,870 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,870 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,870 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,870 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:19,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,871 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,870 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:19,871 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:19,871 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. started... 2023-07-16 01:11:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:19,871 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:19,871 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:19,871 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 50a6795e4743890c7141fa49ddcaee19 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-16 01:11:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:19,871 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:19,872 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:11:19,872 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. started... 2023-07-16 01:11:19,872 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e0baf27bb2b1577c4bd87356c4492375 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-16 01:11:19,876 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:19,876 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:19,876 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:20,029 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307160190c07a99e44f24af94b1570cefac06 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160190c07a99e44f24af94b1570cefac06 2023-07-16 01:11:20,029 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716620397b9e5904707b9fd2edbfc5d5630 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716620397b9e5904707b9fd2edbfc5d5630 2023-07-16 01:11:20,049 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:20,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:20,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:20,056 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:11:20,067 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/.tmp/cf/a3fd32fff47e4436adaf6bbb4ab0000c 2023-07-16 01:11:20,068 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/.tmp/cf/561c7d5efedf4ee7b967311b06de0a28 2023-07-16 01:11:20,078 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/.tmp/cf/561c7d5efedf4ee7b967311b06de0a28 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/cf/561c7d5efedf4ee7b967311b06de0a28 2023-07-16 01:11:20,078 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/.tmp/cf/a3fd32fff47e4436adaf6bbb4ab0000c as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/cf/a3fd32fff47e4436adaf6bbb4ab0000c 2023-07-16 01:11:20,087 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/cf/a3fd32fff47e4436adaf6bbb4ab0000c, entries=4, sequenceid=6, filesize=5.6 K 2023-07-16 01:11:20,088 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/cf/561c7d5efedf4ee7b967311b06de0a28, entries=46, sequenceid=6, filesize=12.6 K 2023-07-16 01:11:20,091 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for e0baf27bb2b1577c4bd87356c4492375 in 219ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:20,091 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 01:11:20,091 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 50a6795e4743890c7141fa49ddcaee19 in 220ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:20,092 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 01:11:20,093 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0baf27bb2b1577c4bd87356c4492375: 2023-07-16 01:11:20,093 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50a6795e4743890c7141fa49ddcaee19: 2023-07-16 01:11:20,094 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 01:11:20,094 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 01:11:20,094 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:20,094 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:20,094 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/cf/561c7d5efedf4ee7b967311b06de0a28] hfiles 2023-07-16 01:11:20,094 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/cf/a3fd32fff47e4436adaf6bbb4ab0000c] hfiles 2023-07-16 01:11:20,094 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/cf/561c7d5efedf4ee7b967311b06de0a28 for snapshot=snaptb0-testExportWithTargetName 2023-07-16 01:11:20,094 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/cf/a3fd32fff47e4436adaf6bbb4ab0000c for snapshot=snaptb0-testExportWithTargetName 2023-07-16 01:11:20,127 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. completed. 2023-07-16 01:11:20,127 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:20,127 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:20,127 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:20,127 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,128 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:20,128 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:11:20,130 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. completed. 2023-07-16 01:11:20,130 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:20,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,130 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,130 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:20,130 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:20,131 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:20,131 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:20,131 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,131 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:20,131 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:11:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:20,134 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,134 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:20,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:20,134 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:20,135 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:20,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:20,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:20,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41771,1689469866681': 2023-07-16 01:11:20,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 01:11:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:20,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:20,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:20,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:20,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:20,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:20,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46827,1689469866564': 2023-07-16 01:11:20,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 01:11:20,146 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-16 01:11:20,146 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:20,146 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:20,146 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-16 01:11:20,146 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:20,148 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,148 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,148 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:20,148 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,148 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,149 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:20,149 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:20,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:20,149 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:20,150 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:20,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,150 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,156 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,156 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,157 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,169 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,169 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:20,169 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,169 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,169 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:20,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:20,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:20,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:20,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:20,170 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:20,170 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,170 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,170 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:20,170 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,170 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:20,170 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:20,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-16 01:11:20,171 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-16 01:11:20,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 01:11:20,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:11:20,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:20,170 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:20,171 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,172 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:20,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:20,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:20,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716620397b9e5904707b9fd2edbfc5d5630, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160190c07a99e44f24af94b1570cefac06] mob files 2023-07-16 01:11:20,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716620397b9e5904707b9fd2edbfc5d5630 2023-07-16 01:11:20,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160190c07a99e44f24af94b1570cefac06 2023-07-16 01:11:20,173 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:20,178 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:20,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:20,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:20,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:20,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:20,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-16 01:11:20,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 01:11:20,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,275 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689469879739Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689469880198 (+459 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689469880198Loading Region manifests for snaptb0-testExportWithTargetName at 1689469880198Writing data manifest for snaptb0-testExportWithTargetName at 1689469880203 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689469880223 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689469880274 (+51 ms) 2023-07-16 01:11:20,277 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:20,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 538 msec 2023-07-16 01:11:20,356 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:20,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:20,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:20,360 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360 2023-07-16 01:11:20,361 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35755, tgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360, rawTgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360, srcFsUri=hdfs://localhost:35755, srcDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:20,416 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:20,416 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_773186138_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 01:11:20,416 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660, snapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-16 01:11:20,460 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 01:11:20,600 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:20,601 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:20,601 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:20,602 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,629 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-2898747491789104028.jar 2023-07-16 01:11:21,630 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,630 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,716 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-3534622348455809029.jar 2023-07-16 01:11:21,717 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,717 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,718 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,718 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,719 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,719 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,720 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:11:21,720 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:11:21,721 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:11:21,721 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:11:21,722 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:11:21,722 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:11:21,723 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:11:21,723 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:11:21,724 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:11:21,724 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:11:21,728 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:21,728 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:21,729 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:21,729 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:21,729 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:21,730 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:21,731 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:22,700 WARN [Listener at jenkins-hbase4.apache.org/32773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:11:22,705 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-16 01:11:22,714 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-16 01:11:23,259 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:11:23,428 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:23,429 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:23,882 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:29,079 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:31,342 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:34,687 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:35,832 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:11:35,834 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:11:35,845 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-16 01:11:35,846 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:11:35,847 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:11:35,847 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 01:11:35,847 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-16 01:11:35,847 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-16 01:11:35,848 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360/.hbase-snapshot/testExportWithTargetName 2023-07-16 01:11:35,848 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-16 01:11:35,848 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469880360/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-16 01:11:35,860 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-16 01:11:35,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-16 01:11:35,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:35,881 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469895881"}]},"ts":"1689469895881"} 2023-07-16 01:11:35,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 01:11:35,883 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-16 01:11:35,957 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-16 01:11:35,959 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e0baf27bb2b1577c4bd87356c4492375, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=50a6795e4743890c7141fa49ddcaee19, UNASSIGN}] 2023-07-16 01:11:35,962 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=50a6795e4743890c7141fa49ddcaee19, UNASSIGN 2023-07-16 01:11:35,962 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e0baf27bb2b1577c4bd87356c4492375, UNASSIGN 2023-07-16 01:11:35,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=50a6795e4743890c7141fa49ddcaee19, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:35,963 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e0baf27bb2b1577c4bd87356c4492375, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:35,963 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469895963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469895963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469895963"}]},"ts":"1689469895963"} 2023-07-16 01:11:35,963 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469895963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469895963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469895963"}]},"ts":"1689469895963"} 2023-07-16 01:11:35,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 50a6795e4743890c7141fa49ddcaee19, server=jenkins-hbase4.apache.org,46827,1689469866564}] 2023-07-16 01:11:35,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure e0baf27bb2b1577c4bd87356c4492375, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:11:35,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 01:11:36,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:36,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:36,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 50a6795e4743890c7141fa49ddcaee19, disabling compactions & flushes 2023-07-16 01:11:36,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e0baf27bb2b1577c4bd87356c4492375, disabling compactions & flushes 2023-07-16 01:11:36,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:36,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:36,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:36,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:36,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. after waiting 0 ms 2023-07-16 01:11:36,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:36,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. after waiting 0 ms 2023-07-16 01:11:36,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:36,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:11:36,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:11:36,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:36,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375. 2023-07-16 01:11:36,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:36,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e0baf27bb2b1577c4bd87356c4492375: 2023-07-16 01:11:36,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19. 2023-07-16 01:11:36,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 50a6795e4743890c7141fa49ddcaee19: 2023-07-16 01:11:36,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:36,153 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e0baf27bb2b1577c4bd87356c4492375, regionState=CLOSED 2023-07-16 01:11:36,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469896153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469896153"}]},"ts":"1689469896153"} 2023-07-16 01:11:36,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:36,154 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=50a6795e4743890c7141fa49ddcaee19, regionState=CLOSED 2023-07-16 01:11:36,154 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469896154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469896154"}]},"ts":"1689469896154"} 2023-07-16 01:11:36,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-16 01:11:36,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure e0baf27bb2b1577c4bd87356c4492375, server=jenkins-hbase4.apache.org,41771,1689469866681 in 191 msec 2023-07-16 01:11:36,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-16 01:11:36,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 50a6795e4743890c7141fa49ddcaee19, server=jenkins-hbase4.apache.org,46827,1689469866564 in 193 msec 2023-07-16 01:11:36,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e0baf27bb2b1577c4bd87356c4492375, UNASSIGN in 202 msec 2023-07-16 01:11:36,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-16 01:11:36,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=50a6795e4743890c7141fa49ddcaee19, UNASSIGN in 204 msec 2023-07-16 01:11:36,166 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469896166"}]},"ts":"1689469896166"} 2023-07-16 01:11:36,168 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-16 01:11:36,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 01:11:36,249 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-16 01:11:36,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 382 msec 2023-07-16 01:11:36,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 01:11:36,487 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-16 01:11:36,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-16 01:11:36,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:36,505 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:36,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-16 01:11:36,507 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:36,510 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-16 01:11:36,513 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:36,513 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:36,516 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/recovered.edits] 2023-07-16 01:11:36,516 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/recovered.edits] 2023-07-16 01:11:36,524 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/cf/a3fd32fff47e4436adaf6bbb4ab0000c to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/cf/a3fd32fff47e4436adaf6bbb4ab0000c 2023-07-16 01:11:36,525 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/cf/561c7d5efedf4ee7b967311b06de0a28 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/cf/561c7d5efedf4ee7b967311b06de0a28 2023-07-16 01:11:36,528 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375/recovered.edits/9.seqid 2023-07-16 01:11:36,529 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19/recovered.edits/9.seqid 2023-07-16 01:11:36,529 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/e0baf27bb2b1577c4bd87356c4492375 2023-07-16 01:11:36,529 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportWithTargetName/50a6795e4743890c7141fa49ddcaee19 2023-07-16 01:11:36,530 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 01:11:36,530 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-16 01:11:36,531 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-16 01:11:36,535 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716620397b9e5904707b9fd2edbfc5d5630 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716620397b9e5904707b9fd2edbfc5d5630 2023-07-16 01:11:36,536 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160190c07a99e44f24af94b1570cefac06 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307160190c07a99e44f24af94b1570cefac06 2023-07-16 01:11:36,536 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-16 01:11:36,541 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:36,562 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-16 01:11:36,565 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-16 01:11:36,567 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:36,567 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-16 01:11:36,567 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469896567"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:36,567 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469896567"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:36,570 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:11:36,570 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e0baf27bb2b1577c4bd87356c4492375, NAME => 'testtb-testExportWithTargetName,,1689469877246.e0baf27bb2b1577c4bd87356c4492375.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 50a6795e4743890c7141fa49ddcaee19, NAME => 'testtb-testExportWithTargetName,1,1689469877246.50a6795e4743890c7141fa49ddcaee19.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:11:36,570 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-16 01:11:36,570 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469896570"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:36,574 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-16 01:11:36,603 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:36,603 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:36,603 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:36,603 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:36,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 01:11:36,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 01:11:36,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 01:11:36,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 01:11:36,651 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:36,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 157 msec 2023-07-16 01:11:36,696 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:36,696 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:36,696 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:36,696 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:36,696 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:36,696 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:36,696 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:36,696 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:36,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 01:11:36,699 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-16 01:11:36,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-16 01:11:36,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:36,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-16 01:11:36,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-16 01:11:36,755 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=750 (was 705) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:49998 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2084597184_1 at /127.0.0.1:55568 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:55592 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:60472 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:39593 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:35023 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=324 (was 290) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=2950 (was 4743) 2023-07-16 01:11:36,755 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-16 01:11:36,775 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=750, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=182, AvailableMemoryMB=2950 2023-07-16 01:11:36,775 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-16 01:11:36,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 01:11:36,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:36,782 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:36,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-16 01:11:36,784 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:36,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 01:11:36,787 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:36,787 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:36,787 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6 empty. 2023-07-16 01:11:36,787 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080 empty. 2023-07-16 01:11:36,788 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:36,788 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:36,788 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 01:11:36,802 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:36,803 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e1de79dc1eeef6ad90bcf79e6069f080, NAME => 'testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:11:36,804 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 20545e330b6c60d17ad60dc4e42688d6, NAME => 'testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:11:36,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:36,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e1de79dc1eeef6ad90bcf79e6069f080, disabling compactions & flushes 2023-07-16 01:11:36,821 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:36,822 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:36,822 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. after waiting 0 ms 2023-07-16 01:11:36,822 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:36,822 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:36,822 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e1de79dc1eeef6ad90bcf79e6069f080: 2023-07-16 01:11:36,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:36,824 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 20545e330b6c60d17ad60dc4e42688d6, disabling compactions & flushes 2023-07-16 01:11:36,824 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:36,824 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:36,824 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. after waiting 0 ms 2023-07-16 01:11:36,824 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:36,824 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:36,824 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 20545e330b6c60d17ad60dc4e42688d6: 2023-07-16 01:11:36,826 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:36,827 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469896827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469896827"}]},"ts":"1689469896827"} 2023-07-16 01:11:36,827 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469896827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469896827"}]},"ts":"1689469896827"} 2023-07-16 01:11:36,830 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:11:36,831 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:36,831 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469896831"}]},"ts":"1689469896831"} 2023-07-16 01:11:36,832 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 01:11:36,835 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:36,837 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:36,837 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:36,837 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:36,837 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:36,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1de79dc1eeef6ad90bcf79e6069f080, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=20545e330b6c60d17ad60dc4e42688d6, ASSIGN}] 2023-07-16 01:11:36,839 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=20545e330b6c60d17ad60dc4e42688d6, ASSIGN 2023-07-16 01:11:36,840 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1de79dc1eeef6ad90bcf79e6069f080, ASSIGN 2023-07-16 01:11:36,841 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=20545e330b6c60d17ad60dc4e42688d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41771,1689469866681; forceNewPlan=false, retain=false 2023-07-16 01:11:36,841 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1de79dc1eeef6ad90bcf79e6069f080, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1689469866617; forceNewPlan=false, retain=false 2023-07-16 01:11:36,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 01:11:36,991 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:11:36,993 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=20545e330b6c60d17ad60dc4e42688d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:36,993 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e1de79dc1eeef6ad90bcf79e6069f080, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:36,994 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469896993"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469896993"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469896993"}]},"ts":"1689469896993"} 2023-07-16 01:11:36,994 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469896993"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469896993"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469896993"}]},"ts":"1689469896993"} 2023-07-16 01:11:36,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 20545e330b6c60d17ad60dc4e42688d6, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:11:36,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure e1de79dc1eeef6ad90bcf79e6069f080, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:11:37,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 01:11:37,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:37,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20545e330b6c60d17ad60dc4e42688d6, NAME => 'testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:11:37,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. service=AccessControlService 2023-07-16 01:11:37,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:37,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:37,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e1de79dc1eeef6ad90bcf79e6069f080, NAME => 'testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:11:37,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:37,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:37,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:37,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:37,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. service=AccessControlService 2023-07-16 01:11:37,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:37,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:37,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:37,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:37,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:37,159 INFO [StoreOpener-20545e330b6c60d17ad60dc4e42688d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:37,160 INFO [StoreOpener-e1de79dc1eeef6ad90bcf79e6069f080-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:37,161 DEBUG [StoreOpener-20545e330b6c60d17ad60dc4e42688d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/cf 2023-07-16 01:11:37,161 DEBUG [StoreOpener-20545e330b6c60d17ad60dc4e42688d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/cf 2023-07-16 01:11:37,161 DEBUG [StoreOpener-e1de79dc1eeef6ad90bcf79e6069f080-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/cf 2023-07-16 01:11:37,161 DEBUG [StoreOpener-e1de79dc1eeef6ad90bcf79e6069f080-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/cf 2023-07-16 01:11:37,161 INFO [StoreOpener-20545e330b6c60d17ad60dc4e42688d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20545e330b6c60d17ad60dc4e42688d6 columnFamilyName cf 2023-07-16 01:11:37,162 INFO [StoreOpener-e1de79dc1eeef6ad90bcf79e6069f080-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1de79dc1eeef6ad90bcf79e6069f080 columnFamilyName cf 2023-07-16 01:11:37,163 INFO [StoreOpener-20545e330b6c60d17ad60dc4e42688d6-1] regionserver.HStore(310): Store=20545e330b6c60d17ad60dc4e42688d6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:37,164 INFO [StoreOpener-e1de79dc1eeef6ad90bcf79e6069f080-1] regionserver.HStore(310): Store=e1de79dc1eeef6ad90bcf79e6069f080/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:37,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:37,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:37,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:37,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:37,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:37,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:37,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:37,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:37,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e1de79dc1eeef6ad90bcf79e6069f080; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65398601, jitterRate=-0.025484904646873474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:37,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e1de79dc1eeef6ad90bcf79e6069f080: 2023-07-16 01:11:37,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 20545e330b6c60d17ad60dc4e42688d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75466369, jitterRate=0.12453652918338776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:37,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 20545e330b6c60d17ad60dc4e42688d6: 2023-07-16 01:11:37,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6., pid=30, masterSystemTime=1689469897148 2023-07-16 01:11:37,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080., pid=31, masterSystemTime=1689469897149 2023-07-16 01:11:37,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:37,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:37,176 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e1de79dc1eeef6ad90bcf79e6069f080, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,177 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469897176"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469897176"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469897176"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469897176"}]},"ts":"1689469897176"} 2023-07-16 01:11:37,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:37,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:37,178 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=20545e330b6c60d17ad60dc4e42688d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,179 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469897177"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469897177"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469897177"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469897177"}]},"ts":"1689469897177"} 2023-07-16 01:11:37,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-16 01:11:37,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure e1de79dc1eeef6ad90bcf79e6069f080, server=jenkins-hbase4.apache.org,38989,1689469866617 in 183 msec 2023-07-16 01:11:37,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-16 01:11:37,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 20545e330b6c60d17ad60dc4e42688d6, server=jenkins-hbase4.apache.org,41771,1689469866681 in 187 msec 2023-07-16 01:11:37,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1de79dc1eeef6ad90bcf79e6069f080, ASSIGN in 346 msec 2023-07-16 01:11:37,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-16 01:11:37,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=20545e330b6c60d17ad60dc4e42688d6, ASSIGN in 348 msec 2023-07-16 01:11:37,189 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:37,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469897189"}]},"ts":"1689469897189"} 2023-07-16 01:11:37,191 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 01:11:37,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:37,194 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-16 01:11:37,197 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:11:37,199 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:37,199 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:37,199 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:37,199 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:37,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:37,202 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:37,202 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:37,202 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:37,204 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 422 msec 2023-07-16 01:11:37,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 01:11:37,389 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-16 01:11:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 01:11:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:37,397 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:37,411 DEBUG [hconnection-0x399bf560-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:37,420 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:37,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:37,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469897427 (current time:1689469897427). 2023-07-16 01:11:37,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:37,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x0741ef00 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:37,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@481fa703, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:37,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:37,437 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:37,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0741ef00 to 127.0.0.1:55425 2023-07-16 01:11:37,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:37,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x06298615 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:37,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e18403f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:37,450 DEBUG [hconnection-0x3b8ac940-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:37,453 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:37,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:37,458 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:37,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06298615 to 127.0.0.1:55425 2023-07-16 01:11:37,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:37,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:11:37,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:37,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:37,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:37,465 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:37,466 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689470497466 2023-07-16 01:11:37,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:37,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 01:11:37,468 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:37,468 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:37,469 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:37,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:37,471 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-16 01:11:37,472 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:37,473 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689470497473 2023-07-16 01:11:37,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,488 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-16 01:11:37,488 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:37,490 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 01:11:37,490 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 01:11:37,491 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,491 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,492 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:37,492 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,492 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:37,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:37,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:37,492 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:37,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:37,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:37,493 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:37,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:37,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,493 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,493 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,494 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:37,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,495 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:37,495 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:37,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,495 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:37,495 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:37,496 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:37,496 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:37,496 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:37,496 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:37,495 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:37,497 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:37,498 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:37,499 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:37,498 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:37,499 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:37,499 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:37,500 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,508 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,508 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:37,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:37,508 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:37,508 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,508 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,508 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:37,509 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,509 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,509 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:37,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:37,509 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:37,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:37,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 01:11:37,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e58d06c[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:37,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:37,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:37,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:37,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:37,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:37,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 01:11:37,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e58d06c[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:37,513 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 01:11:37,514 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,515 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,515 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,515 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,515 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:37,515 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,515 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:37,515 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:37,515 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,516 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. started... 2023-07-16 01:11:37,516 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:37,516 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,516 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:37,515 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:37,517 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:37,517 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:37,517 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:37,517 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20545e330b6c60d17ad60dc4e42688d6: 2023-07-16 01:11:37,517 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. started... 2023-07-16 01:11:37,517 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:37,518 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:11:37,518 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,518 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:37,518 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e1de79dc1eeef6ad90bcf79e6069f080: 2023-07-16 01:11:37,518 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:37,518 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,518 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:37,518 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:37,519 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:37,519 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:37,519 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:37,535 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. completed. 2023-07-16 01:11:37,535 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:37,535 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:37,535 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:37,535 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,535 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:37,535 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:11:37,537 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,537 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:37,537 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:37,537 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:37,539 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. completed. 2023-07-16 01:11:37,539 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:37,539 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:37,539 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:37,542 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,542 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:37,542 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:11:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,545 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:37,545 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,545 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:37,545 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:37,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41771,1689469866681': 2023-07-16 01:11:37,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 01:11:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:37,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:11:37,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 01:11:37,555 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-16 01:11:37,555 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:37,555 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:37,555 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,555 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:37,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:37,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:37,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:37,558 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:37,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,559 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,560 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,563 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,563 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,564 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,567 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:37,567 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:37,567 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:37,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:37,568 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:37,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,568 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,568 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-16 01:11:37,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:37,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:37,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:37,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:37,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:11:37,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:11:37,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:37,570 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:37,570 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:37,570 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:37,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:37,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 01:11:37,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:37,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:37,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,648 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 01:11:37,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,649 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:37,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689469897466Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689469897588 (+122 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689469897588Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689469897588Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689469897593 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689469897611 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689469897648 (+37 ms) 2023-07-16 01:11:37,651 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:37,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 184 msec 2023-07-16 01:11:37,770 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:37,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:11:37,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:37,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38989] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:37,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41771] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:37,782 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 01:11:37,782 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:37,783 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:37,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:37,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469897794 (current time:1689469897794). 2023-07-16 01:11:37,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:37,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x59036a64 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:37,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c8a87d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:37,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:37,805 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:37,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59036a64 to 127.0.0.1:55425 2023-07-16 01:11:37,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:37,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x4dca5ce6 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:37,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7714ed4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:37,815 DEBUG [hconnection-0x3a3aad68-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:37,816 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:37,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:37,823 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:37,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dca5ce6 to 127.0.0.1:55425 2023-07-16 01:11:37,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:37,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:11:37,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:37,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:37,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:37,829 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:37,831 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689470497831 2023-07-16 01:11:37,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:37,831 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 01:11:37,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:37,834 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:37,834 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:37,834 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:37,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 01:11:37,838 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:37,839 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689470497839 2023-07-16 01:11:37,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-16 01:11:37,866 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-16 01:11:37,866 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:37,868 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 01:11:37,868 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 01:11:37,868 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,868 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,870 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:37,870 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:37,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:37,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:37,870 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,870 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:37,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:37,870 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,871 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,871 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,871 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:37,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 01:11:37,872 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:37,872 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:37,872 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:37,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 01:11:37,874 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:37,874 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:37,872 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:37,874 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:37,875 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:37,875 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:37,875 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:37,874 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:37,875 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:37,875 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:37,876 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:37,876 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:37,878 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,879 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,879 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,879 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,879 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,879 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:37,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:37,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:37,880 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,880 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:37,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:37,880 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:37,880 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,880 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:37,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:37,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:37,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 01:11:37,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51655a32[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:37,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:37,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:37,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:37,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:37,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:37,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:37,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:37,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 01:11:37,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51655a32[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:37,886 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 01:11:37,886 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:37,888 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:37,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:37,888 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:11:37,889 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:37,889 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:37,889 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:37,889 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:37,889 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. started... 2023-07-16 01:11:37,889 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:37,889 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:37,889 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:37,889 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:37,889 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:37,889 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 20545e330b6c60d17ad60dc4e42688d6 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-16 01:11:37,889 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. started... 2023-07-16 01:11:37,889 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e1de79dc1eeef6ad90bcf79e6069f080 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-16 01:11:37,892 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:37,892 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:37,892 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:37,935 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:37,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:11:37,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:37,936 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:37,944 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071657a6c461a6d14a108cb18fc7c5ad495b to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071657a6c461a6d14a108cb18fc7c5ad495b 2023-07-16 01:11:37,952 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716ca383386d59b41eab60bd1636dca65e2 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ca383386d59b41eab60bd1636dca65e2 2023-07-16 01:11:37,956 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/.tmp/cf/e8fcd9893ac846199f80730011022a1d 2023-07-16 01:11:37,966 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/.tmp/cf/58caa69e03cf4170a0f80c98c1b78525 2023-07-16 01:11:37,976 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/.tmp/cf/e8fcd9893ac846199f80730011022a1d as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/cf/e8fcd9893ac846199f80730011022a1d 2023-07-16 01:11:37,978 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/.tmp/cf/58caa69e03cf4170a0f80c98c1b78525 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/cf/58caa69e03cf4170a0f80c98c1b78525 2023-07-16 01:11:37,986 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/cf/58caa69e03cf4170a0f80c98c1b78525, entries=45, sequenceid=6, filesize=12.5 K 2023-07-16 01:11:37,987 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 20545e330b6c60d17ad60dc4e42688d6 in 98ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:37,987 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 01:11:37,988 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20545e330b6c60d17ad60dc4e42688d6: 2023-07-16 01:11:37,988 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 01:11:37,988 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:37,988 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/cf/58caa69e03cf4170a0f80c98c1b78525] hfiles 2023-07-16 01:11:37,988 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/cf/58caa69e03cf4170a0f80c98c1b78525 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 01:11:37,991 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/cf/e8fcd9893ac846199f80730011022a1d, entries=5, sequenceid=6, filesize=5.7 K 2023-07-16 01:11:37,992 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for e1de79dc1eeef6ad90bcf79e6069f080 in 103ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:37,994 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e1de79dc1eeef6ad90bcf79e6069f080: 2023-07-16 01:11:37,994 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 01:11:37,994 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:37,994 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/cf/e8fcd9893ac846199f80730011022a1d] hfiles 2023-07-16 01:11:37,994 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/cf/e8fcd9893ac846199f80730011022a1d for snapshot=snaptb0-testExportFileSystemState 2023-07-16 01:11:38,006 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. completed. 2023-07-16 01:11:38,006 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:38,006 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:38,006 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:38,006 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,006 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:38,006 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:11:38,009 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. completed. 2023-07-16 01:11:38,009 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:38,009 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:38,009 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:38,009 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,009 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:38,009 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:11:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:38,013 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:38,013 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:38,015 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:38,015 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:38,015 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:38,015 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:38,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41771,1689469866681': 2023-07-16 01:11:38,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 01:11:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:11:38,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 01:11:38,023 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-16 01:11:38,023 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:38,023 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:38,023 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-16 01:11:38,023 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:38,025 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,025 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,025 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:38,025 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,025 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:38,025 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:38,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:38,025 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:38,026 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:38,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,026 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,027 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:38,029 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,029 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,030 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,033 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,033 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:38,033 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:38,033 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:38,033 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:38,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:38,033 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:38,033 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:38,033 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:38,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:38,033 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:38,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:38,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-16 01:11:38,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-16 01:11:38,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:38,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 01:11:38,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:11:38,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:38,033 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:38,035 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,035 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,035 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:38,035 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,035 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:38,035 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:38,036 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,036 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ca383386d59b41eab60bd1636dca65e2, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071657a6c461a6d14a108cb18fc7c5ad495b] mob files 2023-07-16 01:11:38,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ca383386d59b41eab60bd1636dca65e2 2023-07-16 01:11:38,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071657a6c461a6d14a108cb18fc7c5ad495b 2023-07-16 01:11:38,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-16 01:11:38,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,094 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 01:11:38,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,095 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689469897831Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689469898044 (+213 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689469898044Loading Region manifests for snaptb0-testExportFileSystemState at 1689469898044Writing data manifest for snaptb0-testExportFileSystemState at 1689469898048 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689469898057 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689469898094 (+37 ms) 2023-07-16 01:11:38,097 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:38,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 266 msec 2023-07-16 01:11:38,137 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:38,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:11:38,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:38,138 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138 2023-07-16 01:11:38,138 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35755, tgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138, rawTgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138, srcFsUri=hdfs://localhost:35755, srcDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:38,161 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:38,161 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1871117993_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,161 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660, snapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-16 01:11:38,176 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:38,231 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:38,232 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:38,232 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:38,233 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:39,208 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-3491037516863354463.jar 2023-07-16 01:11:39,208 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:39,209 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:39,283 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-2878083422355709976.jar 2023-07-16 01:11:39,283 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:39,284 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:39,284 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:39,285 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:39,285 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:39,285 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:39,286 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:11:39,286 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:11:39,287 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:11:39,287 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:11:39,287 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:11:39,288 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:11:39,288 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:11:39,289 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:11:39,289 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:11:39,290 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:11:39,291 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:39,292 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:39,293 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:39,293 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:39,293 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:39,294 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:39,295 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:39,929 WARN [Listener at jenkins-hbase4.apache.org/32773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:11:39,932 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-16 01:11:39,934 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-16 01:11:40,892 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:40,892 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:40,899 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:41,137 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0002_000001 (auth:SIMPLE) 2023-07-16 01:11:41,741 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:11:46,102 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0002_000001 (auth:SIMPLE) 2023-07-16 01:11:48,350 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0002_000001 (auth:SIMPLE) 2023-07-16 01:11:51,924 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0002_000001 (auth:SIMPLE) 2023-07-16 01:11:53,136 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:11:53,139 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:11:53,148 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-16 01:11:53,149 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:11:53,149 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:11:53,149 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 01:11:53,150 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 01:11:53,150 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 01:11:53,150 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 01:11:53,151 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 01:11:53,151 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469898138/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 01:11:53,159 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-16 01:11:53,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-16 01:11:53,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:53,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 01:11:53,167 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469913167"}]},"ts":"1689469913167"} 2023-07-16 01:11:53,169 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 01:11:53,171 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-16 01:11:53,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1de79dc1eeef6ad90bcf79e6069f080, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=20545e330b6c60d17ad60dc4e42688d6, UNASSIGN}] 2023-07-16 01:11:53,175 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1de79dc1eeef6ad90bcf79e6069f080, UNASSIGN 2023-07-16 01:11:53,175 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=20545e330b6c60d17ad60dc4e42688d6, UNASSIGN 2023-07-16 01:11:53,176 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e1de79dc1eeef6ad90bcf79e6069f080, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:53,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=20545e330b6c60d17ad60dc4e42688d6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:53,176 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469913176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469913176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469913176"}]},"ts":"1689469913176"} 2023-07-16 01:11:53,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469913176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469913176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469913176"}]},"ts":"1689469913176"} 2023-07-16 01:11:53,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure e1de79dc1eeef6ad90bcf79e6069f080, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:11:53,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 20545e330b6c60d17ad60dc4e42688d6, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:11:53,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 01:11:53,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:53,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e1de79dc1eeef6ad90bcf79e6069f080, disabling compactions & flushes 2023-07-16 01:11:53,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:53,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:53,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. after waiting 0 ms 2023-07-16 01:11:53,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:53,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:53,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 20545e330b6c60d17ad60dc4e42688d6, disabling compactions & flushes 2023-07-16 01:11:53,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:53,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:53,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. after waiting 0 ms 2023-07-16 01:11:53,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:53,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:11:53,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:11:53,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:53,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:53,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6. 2023-07-16 01:11:53,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 20545e330b6c60d17ad60dc4e42688d6: 2023-07-16 01:11:53,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080. 2023-07-16 01:11:53,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e1de79dc1eeef6ad90bcf79e6069f080: 2023-07-16 01:11:53,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:53,353 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=20545e330b6c60d17ad60dc4e42688d6, regionState=CLOSED 2023-07-16 01:11:53,353 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469913353"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469913353"}]},"ts":"1689469913353"} 2023-07-16 01:11:53,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:53,354 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e1de79dc1eeef6ad90bcf79e6069f080, regionState=CLOSED 2023-07-16 01:11:53,354 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469913354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469913354"}]},"ts":"1689469913354"} 2023-07-16 01:11:53,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-16 01:11:53,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 20545e330b6c60d17ad60dc4e42688d6, server=jenkins-hbase4.apache.org,41771,1689469866681 in 175 msec 2023-07-16 01:11:53,358 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-16 01:11:53,358 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure e1de79dc1eeef6ad90bcf79e6069f080, server=jenkins-hbase4.apache.org,38989,1689469866617 in 178 msec 2023-07-16 01:11:53,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=20545e330b6c60d17ad60dc4e42688d6, UNASSIGN in 185 msec 2023-07-16 01:11:53,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-16 01:11:53,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1de79dc1eeef6ad90bcf79e6069f080, UNASSIGN in 186 msec 2023-07-16 01:11:53,362 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469913362"}]},"ts":"1689469913362"} 2023-07-16 01:11:53,363 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 01:11:53,365 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-16 01:11:53,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 206 msec 2023-07-16 01:11:53,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 01:11:53,469 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-16 01:11:53,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-16 01:11:53,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:53,474 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:53,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-16 01:11:53,475 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:53,478 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-16 01:11:53,481 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:53,481 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:53,482 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:53,482 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:53,482 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:53,482 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:53,482 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 01:11:53,482 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 01:11:53,482 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 01:11:53,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 01:11:53,483 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:53,483 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:53,483 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:53,483 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:53,483 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:53,483 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:53,483 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:53,484 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:53,484 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/recovered.edits] 2023-07-16 01:11:53,484 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/recovered.edits] 2023-07-16 01:11:53,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 01:11:53,488 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/cf/e8fcd9893ac846199f80730011022a1d to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/cf/e8fcd9893ac846199f80730011022a1d 2023-07-16 01:11:53,488 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/cf/58caa69e03cf4170a0f80c98c1b78525 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/cf/58caa69e03cf4170a0f80c98c1b78525 2023-07-16 01:11:53,491 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080/recovered.edits/9.seqid 2023-07-16 01:11:53,492 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6/recovered.edits/9.seqid 2023-07-16 01:11:53,492 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/e1de79dc1eeef6ad90bcf79e6069f080 2023-07-16 01:11:53,492 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemState/20545e330b6c60d17ad60dc4e42688d6 2023-07-16 01:11:53,492 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 01:11:53,493 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-16 01:11:53,493 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-16 01:11:53,496 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ca383386d59b41eab60bd1636dca65e2 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ca383386d59b41eab60bd1636dca65e2 2023-07-16 01:11:53,497 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071657a6c461a6d14a108cb18fc7c5ad495b to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071657a6c461a6d14a108cb18fc7c5ad495b 2023-07-16 01:11:53,498 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-16 01:11:53,500 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:53,502 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-16 01:11:53,504 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-16 01:11:53,506 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:53,506 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-16 01:11:53,506 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469913506"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:53,506 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469913506"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:53,508 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:11:53,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e1de79dc1eeef6ad90bcf79e6069f080, NAME => 'testtb-testExportFileSystemState,,1689469896777.e1de79dc1eeef6ad90bcf79e6069f080.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 20545e330b6c60d17ad60dc4e42688d6, NAME => 'testtb-testExportFileSystemState,1,1689469896777.20545e330b6c60d17ad60dc4e42688d6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:11:53,508 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-16 01:11:53,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469913508"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:53,510 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-16 01:11:53,511 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:53,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 41 msec 2023-07-16 01:11:53,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 01:11:53,586 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-16 01:11:53,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-16 01:11:53,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:53,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-16 01:11:53,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-16 01:11:53,628 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2028 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_378037795_1 at /127.0.0.1:52784 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:36451 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:52808 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:43999 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:59242 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:34910 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_378037795_1 at /127.0.0.1:59214 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=934 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=419 (was 324) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=2843 (was 2950) 2023-07-16 01:11:53,628 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 01:11:53,649 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=419, ProcessCount=182, AvailableMemoryMB=2842 2023-07-16 01:11:53,649 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 01:11:53,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 01:11:53,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:11:53,655 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:53,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-16 01:11:53,656 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:53,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 01:11:53,659 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:11:53,659 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:11:53,660 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9 empty. 2023-07-16 01:11:53,660 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d empty. 2023-07-16 01:11:53,660 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:11:53,660 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:11:53,660 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 01:11:53,672 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:53,673 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 36ebfc42c7af3769a6860797f39970b9, NAME => 'testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:11:53,673 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ed605d539f080979be8caf4ca9c56c5d, NAME => 'testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 36ebfc42c7af3769a6860797f39970b9, disabling compactions & flushes 2023-07-16 01:11:53,699 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. after waiting 0 ms 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:53,699 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 36ebfc42c7af3769a6860797f39970b9: 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ed605d539f080979be8caf4ca9c56c5d, disabling compactions & flushes 2023-07-16 01:11:53,699 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:53,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. after waiting 0 ms 2023-07-16 01:11:53,700 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:53,700 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:53,700 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ed605d539f080979be8caf4ca9c56c5d: 2023-07-16 01:11:53,702 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:53,703 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469913703"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469913703"}]},"ts":"1689469913703"} 2023-07-16 01:11:53,703 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469913703"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469913703"}]},"ts":"1689469913703"} 2023-07-16 01:11:53,706 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:11:53,707 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:53,707 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469913707"}]},"ts":"1689469913707"} 2023-07-16 01:11:53,708 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-16 01:11:53,716 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:53,717 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:53,717 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:53,717 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:53,717 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:53,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=36ebfc42c7af3769a6860797f39970b9, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed605d539f080979be8caf4ca9c56c5d, ASSIGN}] 2023-07-16 01:11:53,720 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed605d539f080979be8caf4ca9c56c5d, ASSIGN 2023-07-16 01:11:53,720 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=36ebfc42c7af3769a6860797f39970b9, ASSIGN 2023-07-16 01:11:53,721 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed605d539f080979be8caf4ca9c56c5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41771,1689469866681; forceNewPlan=false, retain=false 2023-07-16 01:11:53,721 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=36ebfc42c7af3769a6860797f39970b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1689469866617; forceNewPlan=false, retain=false 2023-07-16 01:11:53,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 01:11:53,871 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:11:53,874 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ed605d539f080979be8caf4ca9c56c5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:53,874 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=36ebfc42c7af3769a6860797f39970b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:53,875 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469913874"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469913874"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469913874"}]},"ts":"1689469913874"} 2023-07-16 01:11:53,875 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469913874"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469913874"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469913874"}]},"ts":"1689469913874"} 2023-07-16 01:11:53,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure ed605d539f080979be8caf4ca9c56c5d, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:11:53,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 36ebfc42c7af3769a6860797f39970b9, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:11:53,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 01:11:54,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:54,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed605d539f080979be8caf4ca9c56c5d, NAME => 'testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:11:54,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. service=AccessControlService 2023-07-16 01:11:54,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:54,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:54,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36ebfc42c7af3769a6860797f39970b9, NAME => 'testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:11:54,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:11:54,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:54,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:11:54,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. service=AccessControlService 2023-07-16 01:11:54,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:11:54,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:54,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:11:54,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:54,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:11:54,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:11:54,034 INFO [StoreOpener-ed605d539f080979be8caf4ca9c56c5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:11:54,034 INFO [StoreOpener-36ebfc42c7af3769a6860797f39970b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:11:54,036 DEBUG [StoreOpener-ed605d539f080979be8caf4ca9c56c5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/cf 2023-07-16 01:11:54,036 DEBUG [StoreOpener-ed605d539f080979be8caf4ca9c56c5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/cf 2023-07-16 01:11:54,036 DEBUG [StoreOpener-36ebfc42c7af3769a6860797f39970b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/cf 2023-07-16 01:11:54,036 DEBUG [StoreOpener-36ebfc42c7af3769a6860797f39970b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/cf 2023-07-16 01:11:54,036 INFO [StoreOpener-ed605d539f080979be8caf4ca9c56c5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed605d539f080979be8caf4ca9c56c5d columnFamilyName cf 2023-07-16 01:11:54,036 INFO [StoreOpener-36ebfc42c7af3769a6860797f39970b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36ebfc42c7af3769a6860797f39970b9 columnFamilyName cf 2023-07-16 01:11:54,037 INFO [StoreOpener-ed605d539f080979be8caf4ca9c56c5d-1] regionserver.HStore(310): Store=ed605d539f080979be8caf4ca9c56c5d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:54,037 INFO [StoreOpener-36ebfc42c7af3769a6860797f39970b9-1] regionserver.HStore(310): Store=36ebfc42c7af3769a6860797f39970b9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:54,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:11:54,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:11:54,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:11:54,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:11:54,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:11:54,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:11:54,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:54,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:54,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 36ebfc42c7af3769a6860797f39970b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70903730, jitterRate=0.05654790997505188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:54,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 36ebfc42c7af3769a6860797f39970b9: 2023-07-16 01:11:54,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed605d539f080979be8caf4ca9c56c5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69459390, jitterRate=0.035025566816329956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:54,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed605d539f080979be8caf4ca9c56c5d: 2023-07-16 01:11:54,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9., pid=46, masterSystemTime=1689469914029 2023-07-16 01:11:54,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d., pid=45, masterSystemTime=1689469914028 2023-07-16 01:11:54,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:54,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:54,047 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ed605d539f080979be8caf4ca9c56c5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,048 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469914047"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469914047"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469914047"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469914047"}]},"ts":"1689469914047"} 2023-07-16 01:11:54,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:54,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:54,048 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=36ebfc42c7af3769a6860797f39970b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,048 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469914048"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469914048"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469914048"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469914048"}]},"ts":"1689469914048"} 2023-07-16 01:11:54,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-16 01:11:54,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure ed605d539f080979be8caf4ca9c56c5d, server=jenkins-hbase4.apache.org,41771,1689469866681 in 173 msec 2023-07-16 01:11:54,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-16 01:11:54,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 36ebfc42c7af3769a6860797f39970b9, server=jenkins-hbase4.apache.org,38989,1689469866617 in 173 msec 2023-07-16 01:11:54,053 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed605d539f080979be8caf4ca9c56c5d, ASSIGN in 334 msec 2023-07-16 01:11:54,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-16 01:11:54,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=36ebfc42c7af3769a6860797f39970b9, ASSIGN in 334 msec 2023-07-16 01:11:54,055 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:54,055 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469914055"}]},"ts":"1689469914055"} 2023-07-16 01:11:54,056 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-16 01:11:54,059 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:54,059 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-16 01:11:54,061 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 01:11:54,062 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:54,062 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:54,062 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:54,062 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:54,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:54,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:54,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:54,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:54,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 411 msec 2023-07-16 01:11:54,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 01:11:54,261 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-16 01:11:54,263 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 01:11:54,264 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:54,265 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:54,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:54,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469914277 (current time:1689469914277). 2023-07-16 01:11:54,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:54,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x27d197d6 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:54,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d230d8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:54,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:54,289 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:54,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27d197d6 to 127.0.0.1:55425 2023-07-16 01:11:54,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:54,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x5667448f to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:54,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d2306b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:54,299 DEBUG [hconnection-0x18092bf7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:54,302 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:54,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:54,308 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5667448f to 127.0.0.1:55425 2023-07-16 01:11:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 01:11:54,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:54,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:54,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:54,313 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:54,314 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689470514314 2023-07-16 01:11:54,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:54,314 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 01:11:54,316 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:54,316 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:54,320 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:54,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:54,321 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-16 01:11:54,323 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:54,324 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689470514324 2023-07-16 01:11:54,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,345 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-16 01:11:54,345 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:54,347 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 01:11:54,347 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 01:11:54,359 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,359 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,362 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,362 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,362 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,362 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,362 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,362 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,363 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,363 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:54,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 01:11:54,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:54,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 01:11:54,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 01:11:54,364 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:54,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,364 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:54,364 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:54,364 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:54,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:54,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:54,366 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:54,371 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:54,370 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:54,371 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:54,371 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:54,371 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:54,372 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,372 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,373 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,373 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,373 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,373 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:54,373 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,373 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,373 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,374 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,374 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 01:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ac3d392[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 01:11:54,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ac3d392[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:54,377 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 01:11:54,377 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,378 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,378 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,378 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,379 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:11:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:54,379 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,379 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:54,379 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:54,379 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:54,379 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. started... 2023-07-16 01:11:54,379 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. started... 2023-07-16 01:11:54,381 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36ebfc42c7af3769a6860797f39970b9: 2023-07-16 01:11:54,381 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,381 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:54,381 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:54,381 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed605d539f080979be8caf4ca9c56c5d: 2023-07-16 01:11:54,381 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,382 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:54,382 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:54,394 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. completed. 2023-07-16 01:11:54,394 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:54,394 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. completed. 2023-07-16 01:11:54,394 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:54,394 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:54,394 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:54,394 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:54,394 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:54,394 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,394 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,395 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:54,395 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:54,395 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:11:54,395 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:11:54,396 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:54,396 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:54,396 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,396 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:54,396 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:54,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,396 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:54,396 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,398 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:11:54,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 01:11:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41771,1689469866681': 2023-07-16 01:11:54,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 01:11:54,406 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-16 01:11:54,406 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:54,406 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:54,406 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,406 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:54,407 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,407 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,408 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,407 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,407 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,408 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,408 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,408 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,409 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,410 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,411 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,412 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,412 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,415 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,415 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,415 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,415 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,415 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,415 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,415 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:54,415 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,415 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,415 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,417 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,416 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:54,415 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,417 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-16 01:11:54,417 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:11:54,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,417 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,417 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,418 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,418 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,418 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,418 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 01:11:54,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:54,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,418 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:54,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 01:11:54,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 01:11:54,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,480 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:54,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689469914314Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689469914436 (+122 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689469914436Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689469914436Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689469914440 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689469914450 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689469914480 (+30 ms) 2023-07-16 01:11:54,483 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:54,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 167 msec 2023-07-16 01:11:54,618 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:54,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 01:11:54,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:54,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38989] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:54,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41771] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:54,627 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 01:11:54,627 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:54,628 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:54,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:54,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469914639 (current time:1689469914639). 2023-07-16 01:11:54,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:54,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x279b09c3 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:54,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bf597e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:54,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:54,665 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:54,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x279b09c3 to 127.0.0.1:55425 2023-07-16 01:11:54,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:54,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x342b60cd to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:54,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b81b29a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:54,683 DEBUG [hconnection-0x3cbc36d5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:54,686 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:54,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:54,693 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:54,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x342b60cd to 127.0.0.1:55425 2023-07-16 01:11:54,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:54,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 01:11:54,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:54,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:54,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:54,699 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:54,703 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689470514703 2023-07-16 01:11:54,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:54,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 01:11:54,704 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:54,705 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:54,706 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:54,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:54,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-16 01:11:54,710 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:54,711 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689470514711 2023-07-16 01:11:54,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-16 01:11:54,727 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-16 01:11:54,727 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:54,728 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 01:11:54,728 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 01:11:54,729 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,729 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,731 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,731 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,731 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,731 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,732 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,732 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,732 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,732 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:54,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 01:11:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 01:11:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:54,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:54,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 01:11:54,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 01:11:54,734 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:54,734 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:54,734 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:54,734 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:54,736 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:54,736 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:54,736 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:54,736 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:54,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 01:11:54,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,736 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:54,736 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:54,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:54,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 01:11:54,736 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:54,737 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:54,738 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:54,738 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:54,738 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:54,739 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,739 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,740 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,741 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,741 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 01:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bf52eed[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 01:11:54,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bf52eed[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:54,745 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 01:11:54,745 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,746 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,746 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,746 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,746 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:54,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:54,747 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,747 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. started... 2023-07-16 01:11:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:54,747 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:11:54,747 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 36ebfc42c7af3769a6860797f39970b9 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-16 01:11:54,747 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:54,748 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:54,748 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:54,748 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:54,748 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. started... 2023-07-16 01:11:54,748 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ed605d539f080979be8caf4ca9c56c5d 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-16 01:11:54,750 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:54,750 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:54,750 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:54,782 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716ab78ae6d61484effa8d420f760e3c062 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716ab78ae6d61484effa8d420f760e3c062 2023-07-16 01:11:54,783 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307163e42694b33cd4a41ab49d790e63dc48a to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307163e42694b33cd4a41ab49d790e63dc48a 2023-07-16 01:11:54,794 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/.tmp/cf/79f544fe601f45a39737c7138ff92d2d 2023-07-16 01:11:54,797 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/.tmp/cf/dd263c48841045b6b0ac8141f1ef32b3 2023-07-16 01:11:54,801 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/.tmp/cf/79f544fe601f45a39737c7138ff92d2d as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/cf/79f544fe601f45a39737c7138ff92d2d 2023-07-16 01:11:54,803 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/.tmp/cf/dd263c48841045b6b0ac8141f1ef32b3 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/cf/dd263c48841045b6b0ac8141f1ef32b3 2023-07-16 01:11:54,805 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:54,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 01:11:54,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:54,806 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:54,807 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/cf/79f544fe601f45a39737c7138ff92d2d, entries=7, sequenceid=6, filesize=6.1 K 2023-07-16 01:11:54,808 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 36ebfc42c7af3769a6860797f39970b9 in 61ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:54,808 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 01:11:54,808 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36ebfc42c7af3769a6860797f39970b9: 2023-07-16 01:11:54,809 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 01:11:54,809 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:54,809 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/cf/79f544fe601f45a39737c7138ff92d2d] hfiles 2023-07-16 01:11:54,809 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/cf/79f544fe601f45a39737c7138ff92d2d for snapshot=snaptb0-testConsecutiveExports 2023-07-16 01:11:54,809 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/cf/dd263c48841045b6b0ac8141f1ef32b3, entries=43, sequenceid=6, filesize=12.0 K 2023-07-16 01:11:54,810 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for ed605d539f080979be8caf4ca9c56c5d in 62ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:54,811 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed605d539f080979be8caf4ca9c56c5d: 2023-07-16 01:11:54,812 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 01:11:54,812 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:54,812 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/cf/dd263c48841045b6b0ac8141f1ef32b3] hfiles 2023-07-16 01:11:54,812 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/cf/dd263c48841045b6b0ac8141f1ef32b3 for snapshot=snaptb0-testConsecutiveExports 2023-07-16 01:11:54,823 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. completed. 2023-07-16 01:11:54,823 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:11:54,823 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:54,823 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:54,823 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:11:54,827 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,827 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,827 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:54,827 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:54,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,829 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. completed. 2023-07-16 01:11:54,830 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:11:54,830 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:54,830 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:54,830 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,830 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:54,830 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:11:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:54,831 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,832 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:54,832 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:54,832 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:54,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:54,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:11:54,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 01:11:54,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:54,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:54,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41771,1689469866681': 2023-07-16 01:11:54,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 01:11:54,840 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-16 01:11:54,840 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:54,841 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:54,841 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-16 01:11:54,841 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:54,842 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,842 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,842 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,843 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,842 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,843 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,843 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,843 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:54,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:54,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:54,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,844 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:54,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,845 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:54,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,848 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:54,848 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:54,848 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,855 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,855 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,856 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,856 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,856 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,856 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,856 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,856 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:54,856 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,856 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:54,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-16 01:11:54,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,856 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:54,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-16 01:11:54,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:54,856 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,858 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:11:54,859 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,859 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:11:54,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 01:11:54,859 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:11:54,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:11:54,859 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,859 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307163e42694b33cd4a41ab49d790e63dc48a, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716ab78ae6d61484effa8d420f760e3c062] mob files 2023-07-16 01:11:54,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307163e42694b33cd4a41ab49d790e63dc48a 2023-07-16 01:11:54,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716ab78ae6d61484effa8d420f760e3c062 2023-07-16 01:11:54,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-16 01:11:54,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 01:11:54,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,923 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:54,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689469914703Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689469914872 (+169 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689469914872Loading Region manifests for snaptb0-testConsecutiveExports at 1689469914872Writing data manifest for snaptb0-testConsecutiveExports at 1689469914876 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689469914886 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689469914923 (+37 ms) 2023-07-16 01:11:54,926 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:54,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 222 msec 2023-07-16 01:11:55,006 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:55,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 01:11:55,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:55,008 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008 2023-07-16 01:11:55,008 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008, srcFsUri=hdfs://localhost:35755, srcDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:55,030 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:11:55,031 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@dcec66a, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,031 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660, snapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 01:11:55,039 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,052 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:55,052 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:55,052 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:55,053 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,051 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-1481753471803910678.jar 2023-07-16 01:11:56,052 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,052 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,123 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-6915096376808025685.jar 2023-07-16 01:11:56,123 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,124 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,124 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,124 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,125 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,125 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,126 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:11:56,126 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:11:56,127 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:11:56,127 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:11:56,128 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:11:56,128 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:11:56,129 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:11:56,129 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:11:56,130 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:11:56,130 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:11:56,131 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:56,131 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:56,132 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:56,132 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:56,132 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:56,133 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:56,133 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:56,562 WARN [Listener at jenkins-hbase4.apache.org/32773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:11:56,565 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 01:11:56,567 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-16 01:11:58,098 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:58,098 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:58,101 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0002_000001 (auth:SIMPLE) 2023-07-16 01:11:58,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0003_000001 (auth:SIMPLE) 2023-07-16 01:11:58,935 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:12:03,828 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0003_000001 (auth:SIMPLE) 2023-07-16 01:12:06,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0003_000001 (auth:SIMPLE) 2023-07-16 01:12:08,961 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0003_000001 (auth:SIMPLE) 2023-07-16 01:12:10,763 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:12:10,763 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:12:10,767 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 01:12:10,768 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:12:10,768 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:12:10,768 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:12:10,770 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 01:12:10,771 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 01:12:10,771 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@78de6ab0 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:12:10,771 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 01:12:10,771 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 01:12:10,772 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008, srcFsUri=hdfs://localhost:35755, srcDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:12:10,794 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:12:10,794 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1698c18, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:12:10,794 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660, snapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 01:12:10,805 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:12:10,817 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:10,818 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:10,819 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:10,819 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,775 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-6340596040519701021.jar 2023-07-16 01:12:11,775 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,776 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,844 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-6712009337382688335.jar 2023-07-16 01:12:11,845 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,845 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,846 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,846 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,847 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,847 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,848 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:12:11,849 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:12:11,849 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:12:11,850 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:12:11,850 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:12:11,850 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:12:11,851 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:12:11,851 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:12:11,851 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:12:11,852 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:12:11,853 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:11,853 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:11,854 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:11,854 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:11,854 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:11,855 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:11,855 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:12,292 WARN [Listener at jenkins-hbase4.apache.org/32773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:12:12,295 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 01:12:12,297 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-16 01:12:15,157 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:15,157 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:15,159 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0003_000001 (auth:SIMPLE) 2023-07-16 01:12:16,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:21,344 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:23,691 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:27,953 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:29,659 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:12:29,659 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:12:29,663 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 01:12:29,664 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:12:29,664 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:12:29,664 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:12:29,667 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 01:12:29,667 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 01:12:29,667 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@78de6ab0 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:12:29,668 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 01:12:29,668 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/local-export-1689469915008/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 01:12:29,686 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-16 01:12:29,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-16 01:12:29,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:29,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 01:12:29,692 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469949692"}]},"ts":"1689469949692"} 2023-07-16 01:12:29,694 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-16 01:12:29,740 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-16 01:12:29,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=36ebfc42c7af3769a6860797f39970b9, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed605d539f080979be8caf4ca9c56c5d, UNASSIGN}] 2023-07-16 01:12:29,744 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=36ebfc42c7af3769a6860797f39970b9, UNASSIGN 2023-07-16 01:12:29,744 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed605d539f080979be8caf4ca9c56c5d, UNASSIGN 2023-07-16 01:12:29,745 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=36ebfc42c7af3769a6860797f39970b9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:29,745 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469949745"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469949745"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469949745"}]},"ts":"1689469949745"} 2023-07-16 01:12:29,745 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ed605d539f080979be8caf4ca9c56c5d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:29,746 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469949745"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469949745"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469949745"}]},"ts":"1689469949745"} 2023-07-16 01:12:29,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 36ebfc42c7af3769a6860797f39970b9, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:12:29,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure ed605d539f080979be8caf4ca9c56c5d, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:12:29,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 01:12:29,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:12:29,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:12:29,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed605d539f080979be8caf4ca9c56c5d, disabling compactions & flushes 2023-07-16 01:12:29,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 36ebfc42c7af3769a6860797f39970b9, disabling compactions & flushes 2023-07-16 01:12:29,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:12:29,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:12:29,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:12:29,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:12:29,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. after waiting 0 ms 2023-07-16 01:12:29,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. after waiting 0 ms 2023-07-16 01:12:29,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:12:29,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:12:29,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:12:29,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:12:29,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:29,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:29,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d. 2023-07-16 01:12:29,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9. 2023-07-16 01:12:29,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed605d539f080979be8caf4ca9c56c5d: 2023-07-16 01:12:29,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 36ebfc42c7af3769a6860797f39970b9: 2023-07-16 01:12:29,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:12:29,924 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ed605d539f080979be8caf4ca9c56c5d, regionState=CLOSED 2023-07-16 01:12:29,924 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469949924"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469949924"}]},"ts":"1689469949924"} 2023-07-16 01:12:29,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:12:29,925 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=36ebfc42c7af3769a6860797f39970b9, regionState=CLOSED 2023-07-16 01:12:29,925 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469949925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469949925"}]},"ts":"1689469949925"} 2023-07-16 01:12:29,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-16 01:12:29,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure ed605d539f080979be8caf4ca9c56c5d, server=jenkins-hbase4.apache.org,41771,1689469866681 in 178 msec 2023-07-16 01:12:29,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-16 01:12:29,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed605d539f080979be8caf4ca9c56c5d, UNASSIGN in 193 msec 2023-07-16 01:12:29,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 36ebfc42c7af3769a6860797f39970b9, server=jenkins-hbase4.apache.org,38989,1689469866617 in 180 msec 2023-07-16 01:12:29,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-16 01:12:29,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=36ebfc42c7af3769a6860797f39970b9, UNASSIGN in 195 msec 2023-07-16 01:12:29,939 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469949939"}]},"ts":"1689469949939"} 2023-07-16 01:12:29,940 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-16 01:12:29,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 01:12:30,001 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-16 01:12:30,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 315 msec 2023-07-16 01:12:30,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 01:12:30,295 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-16 01:12:30,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-16 01:12:30,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,299 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-16 01:12:30,300 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,303 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-16 01:12:30,306 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:12:30,306 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:12:30,308 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/recovered.edits] 2023-07-16 01:12:30,308 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/recovered.edits] 2023-07-16 01:12:30,313 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/cf/79f544fe601f45a39737c7138ff92d2d to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/cf/79f544fe601f45a39737c7138ff92d2d 2023-07-16 01:12:30,313 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/cf/dd263c48841045b6b0ac8141f1ef32b3 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/cf/dd263c48841045b6b0ac8141f1ef32b3 2023-07-16 01:12:30,316 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9/recovered.edits/9.seqid 2023-07-16 01:12:30,317 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d/recovered.edits/9.seqid 2023-07-16 01:12:30,317 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/36ebfc42c7af3769a6860797f39970b9 2023-07-16 01:12:30,317 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testConsecutiveExports/ed605d539f080979be8caf4ca9c56c5d 2023-07-16 01:12:30,317 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 01:12:30,318 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-16 01:12:30,319 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-16 01:12:30,322 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307163e42694b33cd4a41ab49d790e63dc48a to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307163e42694b33cd4a41ab49d790e63dc48a 2023-07-16 01:12:30,324 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716ab78ae6d61484effa8d420f760e3c062 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230716ab78ae6d61484effa8d420f760e3c062 2023-07-16 01:12:30,324 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-16 01:12:30,327 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,329 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-16 01:12:30,332 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-16 01:12:30,333 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,333 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-16 01:12:30,333 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469950333"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:30,333 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469950333"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:30,335 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:12:30,335 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 36ebfc42c7af3769a6860797f39970b9, NAME => 'testtb-testConsecutiveExports,,1689469913651.36ebfc42c7af3769a6860797f39970b9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ed605d539f080979be8caf4ca9c56c5d, NAME => 'testtb-testConsecutiveExports,1,1689469913651.ed605d539f080979be8caf4ca9c56c5d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:12:30,335 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-16 01:12:30,335 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469950335"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:30,337 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-16 01:12:30,402 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 107 msec 2023-07-16 01:12:30,432 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,432 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,432 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,432 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 01:12:30,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 01:12:30,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 01:12:30,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 01:12:30,447 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,447 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,447 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,447 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,447 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:30,447 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:30,447 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:30,447 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:30,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 01:12:30,448 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-16 01:12:30,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-16 01:12:30,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-16 01:12:30,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-16 01:12:30,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-16 01:12:30,492 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 762), OpenFileDescriptor=893 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=438 (was 419) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=2482 (was 2842) 2023-07-16 01:12:30,492 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-16 01:12:30,517 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=893, MaxFileDescriptor=60000, SystemLoadAverage=438, ProcessCount=184, AvailableMemoryMB=2481 2023-07-16 01:12:30,517 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-16 01:12:30,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 01:12:30,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:30,536 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:12:30,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-16 01:12:30,537 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:12:30,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 01:12:30,542 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:30,542 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:30,543 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73 empty. 2023-07-16 01:12:30,543 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b empty. 2023-07-16 01:12:30,543 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:30,543 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:30,543 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 01:12:30,556 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-16 01:12:30,558 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 541d49516e3d9681e310d419f9500c73, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:12:30,558 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8fe468fdf2fef9831eb0a7c0ef71856b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:12:30,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:30,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 541d49516e3d9681e310d419f9500c73, disabling compactions & flushes 2023-07-16 01:12:30,575 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:30,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:30,576 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:30,576 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 8fe468fdf2fef9831eb0a7c0ef71856b, disabling compactions & flushes 2023-07-16 01:12:30,576 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. after waiting 0 ms 2023-07-16 01:12:30,576 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:30,576 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:30,576 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:30,576 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:30,576 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. after waiting 0 ms 2023-07-16 01:12:30,576 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:30,576 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 541d49516e3d9681e310d419f9500c73: 2023-07-16 01:12:30,576 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:30,576 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 8fe468fdf2fef9831eb0a7c0ef71856b: 2023-07-16 01:12:30,582 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:12:30,583 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469950583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469950583"}]},"ts":"1689469950583"} 2023-07-16 01:12:30,583 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469950583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469950583"}]},"ts":"1689469950583"} 2023-07-16 01:12:30,599 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:12:30,600 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:12:30,600 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469950600"}]},"ts":"1689469950600"} 2023-07-16 01:12:30,602 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-16 01:12:30,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 01:12:30,701 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:12:30,703 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:12:30,703 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:12:30,703 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:12:30,703 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:12:30,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe468fdf2fef9831eb0a7c0ef71856b, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=541d49516e3d9681e310d419f9500c73, ASSIGN}] 2023-07-16 01:12:30,712 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=541d49516e3d9681e310d419f9500c73, ASSIGN 2023-07-16 01:12:30,712 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe468fdf2fef9831eb0a7c0ef71856b, ASSIGN 2023-07-16 01:12:30,714 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=541d49516e3d9681e310d419f9500c73, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46827,1689469866564; forceNewPlan=false, retain=false 2023-07-16 01:12:30,714 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe468fdf2fef9831eb0a7c0ef71856b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1689469866617; forceNewPlan=false, retain=false 2023-07-16 01:12:30,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 01:12:30,865 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:12:30,868 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=541d49516e3d9681e310d419f9500c73, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:30,868 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8fe468fdf2fef9831eb0a7c0ef71856b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:30,868 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469950868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469950868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469950868"}]},"ts":"1689469950868"} 2023-07-16 01:12:30,868 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469950868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469950868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469950868"}]},"ts":"1689469950868"} 2023-07-16 01:12:30,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 541d49516e3d9681e310d419f9500c73, server=jenkins-hbase4.apache.org,46827,1689469866564}] 2023-07-16 01:12:30,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 8fe468fdf2fef9831eb0a7c0ef71856b, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:12:31,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:31,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:31,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fe468fdf2fef9831eb0a7c0ef71856b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:12:31,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 541d49516e3d9681e310d419f9500c73, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:12:31,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. service=AccessControlService 2023-07-16 01:12:31,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. service=AccessControlService 2023-07-16 01:12:31,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:31,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:31,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:31,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:31,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:31,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:31,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:31,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:31,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:31,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:31,034 INFO [StoreOpener-8fe468fdf2fef9831eb0a7c0ef71856b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:31,034 INFO [StoreOpener-541d49516e3d9681e310d419f9500c73-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:31,036 DEBUG [StoreOpener-8fe468fdf2fef9831eb0a7c0ef71856b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/cf 2023-07-16 01:12:31,036 DEBUG [StoreOpener-8fe468fdf2fef9831eb0a7c0ef71856b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/cf 2023-07-16 01:12:31,036 DEBUG [StoreOpener-541d49516e3d9681e310d419f9500c73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/cf 2023-07-16 01:12:31,036 DEBUG [StoreOpener-541d49516e3d9681e310d419f9500c73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/cf 2023-07-16 01:12:31,037 INFO [StoreOpener-8fe468fdf2fef9831eb0a7c0ef71856b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fe468fdf2fef9831eb0a7c0ef71856b columnFamilyName cf 2023-07-16 01:12:31,037 INFO [StoreOpener-541d49516e3d9681e310d419f9500c73-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 541d49516e3d9681e310d419f9500c73 columnFamilyName cf 2023-07-16 01:12:31,038 INFO [StoreOpener-8fe468fdf2fef9831eb0a7c0ef71856b-1] regionserver.HStore(310): Store=8fe468fdf2fef9831eb0a7c0ef71856b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:31,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:31,040 INFO [StoreOpener-541d49516e3d9681e310d419f9500c73-1] regionserver.HStore(310): Store=541d49516e3d9681e310d419f9500c73/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:31,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:31,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:31,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:31,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:31,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:31,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:31,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:31,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8fe468fdf2fef9831eb0a7c0ef71856b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69332000, jitterRate=0.0331273078918457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:31,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 541d49516e3d9681e310d419f9500c73; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75080048, jitterRate=0.11877989768981934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:31,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8fe468fdf2fef9831eb0a7c0ef71856b: 2023-07-16 01:12:31,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 541d49516e3d9681e310d419f9500c73: 2023-07-16 01:12:31,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73., pid=60, masterSystemTime=1689469951026 2023-07-16 01:12:31,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b., pid=61, masterSystemTime=1689469951026 2023-07-16 01:12:31,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:31,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:31,061 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=541d49516e3d9681e310d419f9500c73, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:31,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:31,062 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469951061"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469951061"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469951061"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469951061"}]},"ts":"1689469951061"} 2023-07-16 01:12:31,062 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8fe468fdf2fef9831eb0a7c0ef71856b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,062 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469951062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469951062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469951062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469951062"}]},"ts":"1689469951062"} 2023-07-16 01:12:31,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-16 01:12:31,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 541d49516e3d9681e310d419f9500c73, server=jenkins-hbase4.apache.org,46827,1689469866564 in 199 msec 2023-07-16 01:12:31,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=541d49516e3d9681e310d419f9500c73, ASSIGN in 371 msec 2023-07-16 01:12:31,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-16 01:12:31,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 8fe468fdf2fef9831eb0a7c0ef71856b, server=jenkins-hbase4.apache.org,38989,1689469866617 in 203 msec 2023-07-16 01:12:31,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-16 01:12:31,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe468fdf2fef9831eb0a7c0ef71856b, ASSIGN in 376 msec 2023-07-16 01:12:31,082 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:12:31,082 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469951082"}]},"ts":"1689469951082"} 2023-07-16 01:12:31,084 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-16 01:12:31,087 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:12:31,088 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-16 01:12:31,090 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 01:12:31,091 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:31,091 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:31,091 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:31,091 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:31,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:31,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:31,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:31,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:31,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 573 msec 2023-07-16 01:12:31,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 01:12:31,141 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-16 01:12:31,143 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,144 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:31,145 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:31,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469951163 (current time:1689469951163). 2023-07-16 01:12:31,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:31,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x7d526085 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:31,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13a1d92c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:31,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,177 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d526085 to 127.0.0.1:55425 2023-07-16 01:12:31,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:31,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x31f8c3e5 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:31,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fc0db17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:31,186 DEBUG [hconnection-0x42b5017a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,187 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,193 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31f8c3e5 to 127.0.0.1:55425 2023-07-16 01:12:31,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:31,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 01:12:31,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:31,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,199 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,200 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689470551200 2023-07-16 01:12:31,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,203 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,203 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:31,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,203 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:31,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-16 01:12:31,208 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,209 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689470551209 2023-07-16 01:12:31,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,233 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 01:12:31,233 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,235 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 01:12:31,235 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 01:12:31,299 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,299 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,301 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,301 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,301 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,301 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,302 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,302 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,303 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,303 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,303 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:31,303 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,304 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:31,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,305 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,306 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,306 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,306 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,306 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,306 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,308 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,307 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,309 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,308 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,309 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,309 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,309 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:31,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:31,310 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:31,313 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,315 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,315 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,315 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,315 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,316 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,316 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,316 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,316 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,316 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,316 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 01:12:31,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13765c4f[Count = 1] remaining members to acquire global barrier 2023-07-16 01:12:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 01:12:31,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13765c4f[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:31,325 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 01:12:31,325 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,326 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,327 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,327 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,327 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,327 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,327 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,327 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,327 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:31,327 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:12:31,328 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,328 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:31,334 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:31,335 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:31,335 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:31,335 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. started... 2023-07-16 01:12:31,337 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:31,337 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,337 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:31,342 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:31,345 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:31,345 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:31,345 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. started... 2023-07-16 01:12:31,345 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fe468fdf2fef9831eb0a7c0ef71856b: 2023-07-16 01:12:31,345 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 541d49516e3d9681e310d419f9500c73: 2023-07-16 01:12:31,345 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,345 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:31,345 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,345 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:12:31,345 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:31,346 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:12:31,395 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. completed. 2023-07-16 01:12:31,395 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:31,395 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:31,395 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:31,395 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,395 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:31,395 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:12:31,401 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:31,401 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,401 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:31,401 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,408 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. completed. 2023-07-16 01:12:31,408 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:31,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:12:31,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,412 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:31,412 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,412 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,413 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:31,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:12:31,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 01:12:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46827,1689469866564': 2023-07-16 01:12:31,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 01:12:31,421 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 01:12:31,421 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:31,421 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:31,421 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,421 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:31,424 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,424 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,424 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,424 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,424 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,424 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,424 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,428 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,429 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,431 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,434 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,434 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,434 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,460 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,460 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,460 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,460 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,460 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,460 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,460 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,460 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,460 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,462 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,462 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,461 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:12:31,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,463 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,464 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,464 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,464 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,464 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,464 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,464 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 01:12:31,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,510 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:31,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:31,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:31,511 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:12:31,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,669 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 01:12:31,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,669 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689469951200Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689469951504 (+304 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689469951504Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689469951504Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689469951544 (+40 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689469951582 (+38 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689469951669 (+87 ms) 2023-07-16 01:12:31,676 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 475 msec 2023-07-16 01:12:31,812 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:31,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:31,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:31,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38989] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:12:31,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46827] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:12:31,821 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,821 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:31,821 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:31,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469951833 (current time:1689469951833). 2023-07-16 01:12:31,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:31,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x72417b7f to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:31,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6762dd77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:31,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,850 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72417b7f to 127.0.0.1:55425 2023-07-16 01:12:31,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:31,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x35eb99f8 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:31,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c8886b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:31,867 DEBUG [hconnection-0x3d70733a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,870 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,877 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35eb99f8 to 127.0.0.1:55425 2023-07-16 01:12:31,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:31,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 01:12:31,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:31,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,883 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,883 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689470551883 2023-07-16 01:12:31,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,885 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:31,885 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:31,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,886 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-16 01:12:31,888 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,889 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689470551889 2023-07-16 01:12:31,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,914 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 01:12:31,914 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,915 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 01:12:31,916 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 01:12:31,919 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,919 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,920 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,921 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,921 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,920 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,921 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,921 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,922 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,922 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:31,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 01:12:31,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 01:12:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,923 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 01:12:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,923 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,927 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,927 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,934 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,934 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,932 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,934 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,934 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,934 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,937 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,937 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,937 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,938 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,938 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,938 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,939 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,939 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 01:12:31,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68b930d9[Count = 1] remaining members to acquire global barrier 2023-07-16 01:12:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:31,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 01:12:31,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68b930d9[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:31,944 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 01:12:31,944 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,947 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,947 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,947 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,948 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,948 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:31,948 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:12:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:31,956 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:31,958 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:31,958 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:31,958 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. started... 2023-07-16 01:12:31,958 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:31,959 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 541d49516e3d9681e310d419f9500c73 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-16 01:12:31,959 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. started... 2023-07-16 01:12:31,959 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8fe468fdf2fef9831eb0a7c0ef71856b 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-16 01:12:31,985 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:31,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:31,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:31,987 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:32,018 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716d8890295a2ec4ebe99e72b54def0e168 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d8890295a2ec4ebe99e72b54def0e168 2023-07-16 01:12:32,022 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716046e8712c7414b25b8b8b212636e70af to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230716046e8712c7414b25b8b8b212636e70af 2023-07-16 01:12:32,059 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/.tmp/cf/f6cf3ca615f24a3685cd6c0923aadd8a 2023-07-16 01:12:32,067 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/.tmp/cf/5d25eceb53a7435c94e092f7f0d22a34 2023-07-16 01:12:32,069 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/.tmp/cf/f6cf3ca615f24a3685cd6c0923aadd8a as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/cf/f6cf3ca615f24a3685cd6c0923aadd8a 2023-07-16 01:12:32,075 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/.tmp/cf/5d25eceb53a7435c94e092f7f0d22a34 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/cf/5d25eceb53a7435c94e092f7f0d22a34 2023-07-16 01:12:32,078 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/cf/f6cf3ca615f24a3685cd6c0923aadd8a, entries=6, sequenceid=6, filesize=6.0 K 2023-07-16 01:12:32,079 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 8fe468fdf2fef9831eb0a7c0ef71856b in 120ms, sequenceid=6, compaction requested=false 2023-07-16 01:12:32,079 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-16 01:12:32,080 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fe468fdf2fef9831eb0a7c0ef71856b: 2023-07-16 01:12:32,080 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,080 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:32,080 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/cf/f6cf3ca615f24a3685cd6c0923aadd8a] hfiles 2023-07-16 01:12:32,080 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/cf/f6cf3ca615f24a3685cd6c0923aadd8a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,087 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/cf/5d25eceb53a7435c94e092f7f0d22a34, entries=44, sequenceid=6, filesize=13.0 K 2023-07-16 01:12:32,090 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 541d49516e3d9681e310d419f9500c73 in 131ms, sequenceid=6, compaction requested=false 2023-07-16 01:12:32,096 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 541d49516e3d9681e310d419f9500c73: 2023-07-16 01:12:32,097 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,097 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:32,097 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/cf/5d25eceb53a7435c94e092f7f0d22a34] hfiles 2023-07-16 01:12:32,097 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/cf/5d25eceb53a7435c94e092f7f0d22a34 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,170 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. completed. 2023-07-16 01:12:32,171 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:32,171 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:32,171 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:32,171 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,171 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:32,171 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:12:32,173 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,173 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:32,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:32,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:32,173 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:32,173 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:32,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:32,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:12:32,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 01:12:32,187 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:32,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:32,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:32,188 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:12:32,202 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. completed. 2023-07-16 01:12:32,202 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:32,202 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:32,202 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:32,202 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,202 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:32,202 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:12:32,204 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:32,204 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:32,205 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:32,207 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:32,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:32,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46827,1689469866564': 2023-07-16 01:12:32,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 01:12:32,212 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 01:12:32,212 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:32,212 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:32,212 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,212 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:32,218 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,218 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,218 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,218 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,219 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,219 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,218 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,219 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:32,220 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,220 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,222 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:32,223 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,223 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,226 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,226 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:32,226 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:32,226 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,226 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:32,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:32,226 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:32,226 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:32,226 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:32,229 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:32,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:32,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:12:32,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,226 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:32,229 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,229 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,229 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,230 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,230 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,230 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:32,230 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,230 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,230 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230716046e8712c7414b25b8b8b212636e70af, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d8890295a2ec4ebe99e72b54def0e168] mob files 2023-07-16 01:12:32,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230716046e8712c7414b25b8b8b212636e70af 2023-07-16 01:12:32,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d8890295a2ec4ebe99e72b54def0e168 2023-07-16 01:12:32,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 01:12:32,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,298 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689469951884Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689469952251 (+367 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689469952251Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689469952251Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689469952255 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689469952271 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689469952297 (+26 ms) 2023-07-16 01:12:32,301 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:32,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 417 msec 2023-07-16 01:12:32,489 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:32,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:32,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:32,533 DEBUG [Listener at jenkins-hbase4.apache.org/32773] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:12:32,538 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:12:32,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38989] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 01:12:32,542 DEBUG [Listener at jenkins-hbase4.apache.org/32773] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:12:32,545 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:12:32,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41771] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 01:12:32,546 DEBUG [Listener at jenkins-hbase4.apache.org/32773] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:12:32,548 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:12:32,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46827] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 01:12:32,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:12:32,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:32,557 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:12:32,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-16 01:12:32,558 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:12:32,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 01:12:32,563 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:32,566 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:32,566 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17 empty. 2023-07-16 01:12:32,567 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff empty. 2023-07-16 01:12:32,567 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:32,567 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:32,567 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 01:12:32,587 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-16 01:12:32,588 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d97436b7444251a0be8d982852f49b17, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:12:32,588 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6f43c683679bbae152befbd8665d88ff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:12:32,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:32,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 6f43c683679bbae152befbd8665d88ff, disabling compactions & flushes 2023-07-16 01:12:32,608 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:32,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:32,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. after waiting 0 ms 2023-07-16 01:12:32,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:32,608 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:32,608 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 6f43c683679bbae152befbd8665d88ff: 2023-07-16 01:12:32,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:32,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d97436b7444251a0be8d982852f49b17, disabling compactions & flushes 2023-07-16 01:12:32,614 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:32,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:32,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. after waiting 0 ms 2023-07-16 01:12:32,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:32,614 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:32,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d97436b7444251a0be8d982852f49b17: 2023-07-16 01:12:32,618 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:12:32,619 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952619"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469952619"}]},"ts":"1689469952619"} 2023-07-16 01:12:32,619 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952619"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469952619"}]},"ts":"1689469952619"} 2023-07-16 01:12:32,621 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:12:32,622 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:12:32,623 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469952622"}]},"ts":"1689469952622"} 2023-07-16 01:12:32,624 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-16 01:12:32,627 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:12:32,629 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:12:32,629 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:12:32,629 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:12:32,629 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:12:32,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d97436b7444251a0be8d982852f49b17, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f43c683679bbae152befbd8665d88ff, ASSIGN}] 2023-07-16 01:12:32,632 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f43c683679bbae152befbd8665d88ff, ASSIGN 2023-07-16 01:12:32,632 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d97436b7444251a0be8d982852f49b17, ASSIGN 2023-07-16 01:12:32,633 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f43c683679bbae152befbd8665d88ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1689469866617; forceNewPlan=false, retain=false 2023-07-16 01:12:32,633 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d97436b7444251a0be8d982852f49b17, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41771,1689469866681; forceNewPlan=false, retain=false 2023-07-16 01:12:32,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 01:12:32,783 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:12:32,787 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6f43c683679bbae152befbd8665d88ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:32,787 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d97436b7444251a0be8d982852f49b17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,787 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952787"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469952787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469952787"}]},"ts":"1689469952787"} 2023-07-16 01:12:32,787 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952787"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469952787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469952787"}]},"ts":"1689469952787"} 2023-07-16 01:12:32,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 6f43c683679bbae152befbd8665d88ff, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:12:32,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure d97436b7444251a0be8d982852f49b17, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:12:32,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 01:12:32,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:32,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:32,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f43c683679bbae152befbd8665d88ff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.', STARTKEY => '2', ENDKEY => ''} 2023-07-16 01:12:32,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d97436b7444251a0be8d982852f49b17, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.', STARTKEY => '', ENDKEY => '2'} 2023-07-16 01:12:32,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. service=AccessControlService 2023-07-16 01:12:32,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:32,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:32,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:32,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:32,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:32,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. service=AccessControlService 2023-07-16 01:12:32,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:32,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:32,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:32,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:32,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:32,963 INFO [StoreOpener-d97436b7444251a0be8d982852f49b17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:32,967 DEBUG [StoreOpener-d97436b7444251a0be8d982852f49b17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/cf 2023-07-16 01:12:32,967 DEBUG [StoreOpener-d97436b7444251a0be8d982852f49b17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/cf 2023-07-16 01:12:32,967 INFO [StoreOpener-6f43c683679bbae152befbd8665d88ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:32,968 INFO [StoreOpener-d97436b7444251a0be8d982852f49b17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d97436b7444251a0be8d982852f49b17 columnFamilyName cf 2023-07-16 01:12:32,977 INFO [StoreOpener-d97436b7444251a0be8d982852f49b17-1] regionserver.HStore(310): Store=d97436b7444251a0be8d982852f49b17/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:32,979 DEBUG [StoreOpener-6f43c683679bbae152befbd8665d88ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/cf 2023-07-16 01:12:32,979 DEBUG [StoreOpener-6f43c683679bbae152befbd8665d88ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/cf 2023-07-16 01:12:32,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:32,980 INFO [StoreOpener-6f43c683679bbae152befbd8665d88ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f43c683679bbae152befbd8665d88ff columnFamilyName cf 2023-07-16 01:12:32,981 INFO [StoreOpener-6f43c683679bbae152befbd8665d88ff-1] regionserver.HStore(310): Store=6f43c683679bbae152befbd8665d88ff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:32,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:32,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:32,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:32,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:32,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:32,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:32,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d97436b7444251a0be8d982852f49b17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66807528, jitterRate=-0.004490256309509277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:32,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d97436b7444251a0be8d982852f49b17: 2023-07-16 01:12:32,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:32,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17., pid=70, masterSystemTime=1689469952943 2023-07-16 01:12:32,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f43c683679bbae152befbd8665d88ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61106348, jitterRate=-0.08944445848464966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:32,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f43c683679bbae152befbd8665d88ff: 2023-07-16 01:12:32,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff., pid=69, masterSystemTime=1689469952943 2023-07-16 01:12:32,996 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d97436b7444251a0be8d982852f49b17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:32,997 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952996"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469952996"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469952996"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469952996"}]},"ts":"1689469952996"} 2023-07-16 01:12:32,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:32,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:33,000 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6f43c683679bbae152befbd8665d88ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:33,000 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952999"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469952999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469952999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469952999"}]},"ts":"1689469952999"} 2023-07-16 01:12:33,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-16 01:12:33,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure d97436b7444251a0be8d982852f49b17, server=jenkins-hbase4.apache.org,41771,1689469866681 in 209 msec 2023-07-16 01:12:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:33,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:33,008 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-16 01:12:33,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d97436b7444251a0be8d982852f49b17, ASSIGN in 374 msec 2023-07-16 01:12:33,008 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 6f43c683679bbae152befbd8665d88ff, server=jenkins-hbase4.apache.org,38989,1689469866617 in 212 msec 2023-07-16 01:12:33,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-16 01:12:33,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f43c683679bbae152befbd8665d88ff, ASSIGN in 379 msec 2023-07-16 01:12:33,011 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:12:33,011 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469953011"}]},"ts":"1689469953011"} 2023-07-16 01:12:33,013 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-16 01:12:33,015 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:12:33,016 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-16 01:12:33,017 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 01:12:33,019 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:33,019 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:33,019 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:33,019 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:33,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:33,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:33,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:33,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:33,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:33,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:33,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:33,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:33,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 469 msec 2023-07-16 01:12:33,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 01:12:33,163 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-16 01:12:33,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions d97436b7444251a0be8d982852f49b17, 6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:33,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d97436b7444251a0be8d982852f49b17, 6f43c683679bbae152befbd8665d88ff], force=true 2023-07-16 01:12:33,217 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d97436b7444251a0be8d982852f49b17, 6f43c683679bbae152befbd8665d88ff], force=true 2023-07-16 01:12:33,217 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d97436b7444251a0be8d982852f49b17, 6f43c683679bbae152befbd8665d88ff], force=true 2023-07-16 01:12:33,217 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d97436b7444251a0be8d982852f49b17, 6f43c683679bbae152befbd8665d88ff], force=true 2023-07-16 01:12:33,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:33,240 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 01:12:33,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d97436b7444251a0be8d982852f49b17, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f43c683679bbae152befbd8665d88ff, UNASSIGN}] 2023-07-16 01:12:33,252 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d97436b7444251a0be8d982852f49b17, UNASSIGN 2023-07-16 01:12:33,253 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d97436b7444251a0be8d982852f49b17, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:33,253 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469953253"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469953253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469953253"}]},"ts":"1689469953253"} 2023-07-16 01:12:33,256 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f43c683679bbae152befbd8665d88ff, UNASSIGN 2023-07-16 01:12:33,257 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6f43c683679bbae152befbd8665d88ff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:33,258 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469953257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469953257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469953257"}]},"ts":"1689469953257"} 2023-07-16 01:12:33,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure d97436b7444251a0be8d982852f49b17, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:12:33,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 6f43c683679bbae152befbd8665d88ff, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:12:33,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:33,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:33,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d97436b7444251a0be8d982852f49b17, disabling compactions & flushes 2023-07-16 01:12:33,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:33,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:33,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. after waiting 0 ms 2023-07-16 01:12:33,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:33,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d97436b7444251a0be8d982852f49b17 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 01:12:33,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:33,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f43c683679bbae152befbd8665d88ff, disabling compactions & flushes 2023-07-16 01:12:33,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:33,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:33,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. after waiting 0 ms 2023-07-16 01:12:33,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:33,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6f43c683679bbae152befbd8665d88ff 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 01:12:33,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/.tmp/cf/7ef3da9ce2df4cae9586d36a41cfda33 2023-07-16 01:12:33,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/.tmp/cf/0e58265824de43be91e5b993b4cb41d7 2023-07-16 01:12:33,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/.tmp/cf/0e58265824de43be91e5b993b4cb41d7 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/cf/0e58265824de43be91e5b993b4cb41d7 2023-07-16 01:12:33,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/.tmp/cf/7ef3da9ce2df4cae9586d36a41cfda33 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/cf/7ef3da9ce2df4cae9586d36a41cfda33 2023-07-16 01:12:33,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/cf/0e58265824de43be91e5b993b4cb41d7, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 01:12:33,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/cf/7ef3da9ce2df4cae9586d36a41cfda33, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 01:12:33,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6f43c683679bbae152befbd8665d88ff in 85ms, sequenceid=5, compaction requested=false 2023-07-16 01:12:33,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d97436b7444251a0be8d982852f49b17 in 88ms, sequenceid=5, compaction requested=false 2023-07-16 01:12:33,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:33,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 01:12:33,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 01:12:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:33,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff. 2023-07-16 01:12:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f43c683679bbae152befbd8665d88ff: 2023-07-16 01:12:33,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17. 2023-07-16 01:12:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d97436b7444251a0be8d982852f49b17: 2023-07-16 01:12:33,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:33,536 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6f43c683679bbae152befbd8665d88ff, regionState=CLOSED 2023-07-16 01:12:33,536 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469953536"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469953536"}]},"ts":"1689469953536"} 2023-07-16 01:12:33,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:33,537 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d97436b7444251a0be8d982852f49b17, regionState=CLOSED 2023-07-16 01:12:33,537 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469953537"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469953537"}]},"ts":"1689469953537"} 2023-07-16 01:12:33,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-16 01:12:33,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 6f43c683679bbae152befbd8665d88ff, server=jenkins-hbase4.apache.org,38989,1689469866617 in 275 msec 2023-07-16 01:12:33,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-16 01:12:33,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure d97436b7444251a0be8d982852f49b17, server=jenkins-hbase4.apache.org,41771,1689469866681 in 278 msec 2023-07-16 01:12:33,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6f43c683679bbae152befbd8665d88ff, UNASSIGN in 290 msec 2023-07-16 01:12:33,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-16 01:12:33,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d97436b7444251a0be8d982852f49b17, UNASSIGN in 296 msec 2023-07-16 01:12:33,662 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-16 01:12:33,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952552.d97436b7444251a0be8d982852f49b17.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:33,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952552.6f43c683679bbae152befbd8665d88ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:33,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:33,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7a685b57cdbdfef2d7fc7e5aafd73eb, ASSIGN}] 2023-07-16 01:12:33,722 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7a685b57cdbdfef2d7fc7e5aafd73eb, ASSIGN 2023-07-16 01:12:33,723 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7a685b57cdbdfef2d7fc7e5aafd73eb, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,41771,1689469866681; forceNewPlan=false, retain=false 2023-07-16 01:12:33,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:33,873 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 01:12:33,876 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b7a685b57cdbdfef2d7fc7e5aafd73eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:33,876 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689469953876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469953876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469953876"}]},"ts":"1689469953876"} 2023-07-16 01:12:33,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure b7a685b57cdbdfef2d7fc7e5aafd73eb, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:12:34,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. 2023-07-16 01:12:34,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b7a685b57cdbdfef2d7fc7e5aafd73eb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:12:34,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. service=AccessControlService 2023-07-16 01:12:34,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:34,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:34,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:34,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:34,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:34,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/.regioninfo 2023-07-16 01:12:34,052 INFO [StoreOpener-b7a685b57cdbdfef2d7fc7e5aafd73eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:34,054 DEBUG [StoreOpener-b7a685b57cdbdfef2d7fc7e5aafd73eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf 2023-07-16 01:12:34,054 DEBUG [StoreOpener-b7a685b57cdbdfef2d7fc7e5aafd73eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf 2023-07-16 01:12:34,054 INFO [StoreOpener-b7a685b57cdbdfef2d7fc7e5aafd73eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7a685b57cdbdfef2d7fc7e5aafd73eb columnFamilyName cf 2023-07-16 01:12:34,089 DEBUG [StoreOpener-b7a685b57cdbdfef2d7fc7e5aafd73eb-1] regionserver.HStore(539): loaded hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/0e58265824de43be91e5b993b4cb41d7.6f43c683679bbae152befbd8665d88ff->hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/cf/0e58265824de43be91e5b993b4cb41d7-top 2023-07-16 01:12:34,101 DEBUG [StoreOpener-b7a685b57cdbdfef2d7fc7e5aafd73eb-1] regionserver.HStore(539): loaded hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/7ef3da9ce2df4cae9586d36a41cfda33.d97436b7444251a0be8d982852f49b17->hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/cf/7ef3da9ce2df4cae9586d36a41cfda33-top 2023-07-16 01:12:34,102 INFO [StoreOpener-b7a685b57cdbdfef2d7fc7e5aafd73eb-1] regionserver.HStore(310): Store=b7a685b57cdbdfef2d7fc7e5aafd73eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:34,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:34,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:34,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:34,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b7a685b57cdbdfef2d7fc7e5aafd73eb; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69411009, jitterRate=0.03430463373661041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:34,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b7a685b57cdbdfef2d7fc7e5aafd73eb: 2023-07-16 01:12:34,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb., pid=77, masterSystemTime=1689469954030 2023-07-16 01:12:34,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.,because compaction is disabled. 2023-07-16 01:12:34,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. 2023-07-16 01:12:34,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. 2023-07-16 01:12:34,117 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b7a685b57cdbdfef2d7fc7e5aafd73eb, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,118 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689469954117"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469954117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469954117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469954117"}]},"ts":"1689469954117"} 2023-07-16 01:12:34,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-16 01:12:34,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure b7a685b57cdbdfef2d7fc7e5aafd73eb, server=jenkins-hbase4.apache.org,41771,1689469866681 in 242 msec 2023-07-16 01:12:34,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-16 01:12:34,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7a685b57cdbdfef2d7fc7e5aafd73eb, ASSIGN in 402 msec 2023-07-16 01:12:34,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d97436b7444251a0be8d982852f49b17, 6f43c683679bbae152befbd8665d88ff], force=true in 917 msec 2023-07-16 01:12:34,178 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:34,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:34,330 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-16 01:12:34,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 01:12:34,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469954331 (current time:1689469954331). 2023-07-16 01:12:34,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:34,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x51dcad15 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:34,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14ef98c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:34,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:34,349 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:34,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51dcad15 to 127.0.0.1:55425 2023-07-16 01:12:34,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x439522fe to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:34,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77159b9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:34,395 DEBUG [hconnection-0x1fd42c2f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:34,400 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:34,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:34,410 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:34,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x439522fe to 127.0.0.1:55425 2023-07-16 01:12:34,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:34,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 01:12:34,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:34,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 01:12:34,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 01:12:34,428 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 01:12:34,430 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689470554430 2023-07-16 01:12:34,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 01:12:34,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,436 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:34,436 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:34,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 01:12:34,438 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 01:12:34,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 14 msec 2023-07-16 01:12:34,447 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 01:12:34,449 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689470554449 2023-07-16 01:12:34,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,510 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 01:12:34,510 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:34,511 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-16 01:12:34,511 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-16 01:12:34,512 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,512 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,518 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,518 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,519 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,518 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,521 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,521 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:34,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 01:12:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,522 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 01:12:34,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,522 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 01:12:34,522 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 01:12:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 01:12:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 01:12:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 01:12:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 01:12:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 01:12:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 01:12:34,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,530 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,530 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 01:12:34,530 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 01:12:34,530 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:34,530 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:34,535 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 01:12:34,535 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 01:12:34,535 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 01:12:34,535 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 01:12:34,535 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 01:12:34,535 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 01:12:34,536 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:34,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 01:12:34,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:34,537 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,537 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:34,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:34,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:34,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:34,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:34,540 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,540 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:34,541 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,542 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,542 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:34,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:34,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:34,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:34,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-16 01:12:34,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c72311f[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:34,551 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-16 01:12:34,551 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,552 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,552 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,552 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,553 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,553 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,553 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 01:12:34,553 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 01:12:34,553 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 01:12:34,553 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 01:12:34,553 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 01:12:34,553 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:12:34,553 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:12:34,555 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 01:12:34,555 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:34,555 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 01:12:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 01:12:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 01:12:34,563 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:34,576 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:34,578 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. 2023-07-16 01:12:34,578 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. started... 2023-07-16 01:12:34,580 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b7a685b57cdbdfef2d7fc7e5aafd73eb: 2023-07-16 01:12:34,580 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,580 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:34,580 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/0e58265824de43be91e5b993b4cb41d7.6f43c683679bbae152befbd8665d88ff->hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/cf/0e58265824de43be91e5b993b4cb41d7-top, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/7ef3da9ce2df4cae9586d36a41cfda33.d97436b7444251a0be8d982852f49b17->hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/cf/7ef3da9ce2df4cae9586d36a41cfda33-top] hfiles 2023-07-16 01:12:34,580 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/0e58265824de43be91e5b993b4cb41d7.6f43c683679bbae152befbd8665d88ff for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,581 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/7ef3da9ce2df4cae9586d36a41cfda33.d97436b7444251a0be8d982852f49b17 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,622 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. completed. 2023-07-16 01:12:34,622 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. 2023-07-16 01:12:34,622 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:34,622 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:34,622 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,622 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 01:12:34,623 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:12:34,630 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 01:12:34,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:34,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 01:12:34,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:34,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:34,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:34,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:34,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:34,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,41771,1689469866681': 2023-07-16 01:12:34,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-16 01:12:34,635 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-16 01:12:34,635 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:34,635 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:34,635 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,635 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:34,639 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:34,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,647 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:34,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:34,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,648 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:34,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:34,649 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:34,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:34,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:34,653 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:34,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,653 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:34,654 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,658 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,658 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,658 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,658 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,658 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:34,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,658 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,658 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:34,658 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,658 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:34,659 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,659 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:34,659 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,659 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:34,659 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:34,659 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,659 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,660 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,660 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,738 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:34,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 01:12:34,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:34,739 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:12:34,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-16 01:12:34,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,844 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689469954430Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689469954658 (+228 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689469954658Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689469954678 (+20 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689469954748 (+70 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689469954843 (+95 ms) 2023-07-16 01:12:34,847 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 01:12:34,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 412 msec 2023-07-16 01:12:35,040 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:35,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 01:12:35,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:35,041 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041 2023-07-16 01:12:35,041 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35755, tgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041, rawTgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041, srcFsUri=hdfs://localhost:35755, srcDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:12:35,070 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:12:35,070 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1484512633_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:35,070 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660, snapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-16 01:12:35,083 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:35,142 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:35,143 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:35,143 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:35,144 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:35,515 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:12:36,333 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-8380981381758910408.jar 2023-07-16 01:12:36,334 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,334 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,422 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-3353477532668186222.jar 2023-07-16 01:12:36,423 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,424 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,424 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,425 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,425 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,426 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,427 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:12:36,427 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:12:36,428 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:12:36,428 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:12:36,429 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:12:36,430 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:12:36,430 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:12:36,431 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:12:36,431 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:12:36,432 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:12:36,433 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:36,434 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:36,435 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:36,435 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:36,435 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:36,436 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:36,437 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:38,092 WARN [Listener at jenkins-hbase4.apache.org/32773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:12:38,095 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-16 01:12:38,097 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-16 01:12:38,209 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:38,209 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:39,180 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:45,440 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:47,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:51,443 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:53,385 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:12:53,389 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:12:53,399 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,399 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:12:53,400 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:12:53,400 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,401 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 01:12:53,401 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 01:12:53,401 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,402 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 01:12:53,402 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469955041/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 01:12:53,412 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 01:12:53,431 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469973431"}]},"ts":"1689469973431"} 2023-07-16 01:12:53,432 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-16 01:12:53,437 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-16 01:12:53,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7a685b57cdbdfef2d7fc7e5aafd73eb, UNASSIGN}] 2023-07-16 01:12:53,441 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7a685b57cdbdfef2d7fc7e5aafd73eb, UNASSIGN 2023-07-16 01:12:53,442 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b7a685b57cdbdfef2d7fc7e5aafd73eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:53,442 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689469973441"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469973441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469973441"}]},"ts":"1689469973441"} 2023-07-16 01:12:53,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure b7a685b57cdbdfef2d7fc7e5aafd73eb, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:12:53,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 01:12:53,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:53,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b7a685b57cdbdfef2d7fc7e5aafd73eb, disabling compactions & flushes 2023-07-16 01:12:53,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. 2023-07-16 01:12:53,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. 2023-07-16 01:12:53,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. after waiting 0 ms 2023-07-16 01:12:53,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. 2023-07-16 01:12:53,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-16 01:12:53,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:53,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb. 2023-07-16 01:12:53,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b7a685b57cdbdfef2d7fc7e5aafd73eb: 2023-07-16 01:12:53,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:53,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b7a685b57cdbdfef2d7fc7e5aafd73eb, regionState=CLOSED 2023-07-16 01:12:53,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689469973614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469973614"}]},"ts":"1689469973614"} 2023-07-16 01:12:53,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-16 01:12:53,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure b7a685b57cdbdfef2d7fc7e5aafd73eb, server=jenkins-hbase4.apache.org,41771,1689469866681 in 172 msec 2023-07-16 01:12:53,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-16 01:12:53,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7a685b57cdbdfef2d7fc7e5aafd73eb, UNASSIGN in 179 msec 2023-07-16 01:12:53,619 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469973619"}]},"ts":"1689469973619"} 2023-07-16 01:12:53,621 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-16 01:12:53,622 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-16 01:12:53,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 209 msec 2023-07-16 01:12:53,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 01:12:53,725 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-16 01:12:53,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,730 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,730 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,735 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,736 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:53,736 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:53,736 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:53,738 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/recovered.edits] 2023-07-16 01:12:53,739 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/recovered.edits] 2023-07-16 01:12:53,739 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,739 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,739 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,739 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,740 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/recovered.edits] 2023-07-16 01:12:53,740 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:53,740 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:53,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 01:12:53,741 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:12:53,741 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:53,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 01:12:53,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 01:12:53,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 01:12:53,741 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:53,741 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:12:53,741 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:12:53,741 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:12:53,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:53,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 01:12:53,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:53,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:53,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:53,748 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/cf/0e58265824de43be91e5b993b4cb41d7 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/cf/0e58265824de43be91e5b993b4cb41d7 2023-07-16 01:12:53,749 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/0e58265824de43be91e5b993b4cb41d7.6f43c683679bbae152befbd8665d88ff to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/0e58265824de43be91e5b993b4cb41d7.6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:53,750 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/cf/7ef3da9ce2df4cae9586d36a41cfda33 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/cf/7ef3da9ce2df4cae9586d36a41cfda33 2023-07-16 01:12:53,752 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/recovered.edits/8.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff/recovered.edits/8.seqid 2023-07-16 01:12:53,753 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/7ef3da9ce2df4cae9586d36a41cfda33.d97436b7444251a0be8d982852f49b17 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/cf/7ef3da9ce2df4cae9586d36a41cfda33.d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:53,754 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6f43c683679bbae152befbd8665d88ff 2023-07-16 01:12:53,758 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/recovered.edits/8.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17/recovered.edits/8.seqid 2023-07-16 01:12:53,758 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/recovered.edits/12.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb/recovered.edits/12.seqid 2023-07-16 01:12:53,759 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7a685b57cdbdfef2d7fc7e5aafd73eb 2023-07-16 01:12:53,759 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d97436b7444251a0be8d982852f49b17 2023-07-16 01:12:53,759 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 01:12:53,762 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,776 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-16 01:12:53,779 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-16 01:12:53,780 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,780 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-16 01:12:53,780 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469973780"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:53,784 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-16 01:12:53,784 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b7a685b57cdbdfef2d7fc7e5aafd73eb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952553.b7a685b57cdbdfef2d7fc7e5aafd73eb.', STARTKEY => '', ENDKEY => ''}] 2023-07-16 01:12:53,784 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-16 01:12:53,784 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469973784"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:53,786 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-16 01:12:53,788 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:53,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 62 msec 2023-07-16 01:12:53,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 01:12:53,844 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-16 01:12:53,844 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:53,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:53,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:53,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 01:12:53,850 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469973850"}]},"ts":"1689469973850"} 2023-07-16 01:12:53,851 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-16 01:12:53,853 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-16 01:12:53,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe468fdf2fef9831eb0a7c0ef71856b, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=541d49516e3d9681e310d419f9500c73, UNASSIGN}] 2023-07-16 01:12:53,855 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=541d49516e3d9681e310d419f9500c73, UNASSIGN 2023-07-16 01:12:53,855 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe468fdf2fef9831eb0a7c0ef71856b, UNASSIGN 2023-07-16 01:12:53,856 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=541d49516e3d9681e310d419f9500c73, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:53,856 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8fe468fdf2fef9831eb0a7c0ef71856b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:53,857 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469973856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469973856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469973856"}]},"ts":"1689469973856"} 2023-07-16 01:12:53,857 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469973856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469973856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469973856"}]},"ts":"1689469973856"} 2023-07-16 01:12:53,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 541d49516e3d9681e310d419f9500c73, server=jenkins-hbase4.apache.org,46827,1689469866564}] 2023-07-16 01:12:53,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 8fe468fdf2fef9831eb0a7c0ef71856b, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:12:53,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 01:12:54,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:54,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:54,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 541d49516e3d9681e310d419f9500c73, disabling compactions & flushes 2023-07-16 01:12:54,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:54,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8fe468fdf2fef9831eb0a7c0ef71856b, disabling compactions & flushes 2023-07-16 01:12:54,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:54,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:54,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. after waiting 0 ms 2023-07-16 01:12:54,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:54,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:54,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. after waiting 0 ms 2023-07-16 01:12:54,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:54,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:12:54,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:54,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b. 2023-07-16 01:12:54,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8fe468fdf2fef9831eb0a7c0ef71856b: 2023-07-16 01:12:54,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:54,113 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8fe468fdf2fef9831eb0a7c0ef71856b, regionState=CLOSED 2023-07-16 01:12:54,113 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469974113"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469974113"}]},"ts":"1689469974113"} 2023-07-16 01:12:54,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:12:54,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:54,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73. 2023-07-16 01:12:54,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 541d49516e3d9681e310d419f9500c73: 2023-07-16 01:12:54,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-16 01:12:54,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 8fe468fdf2fef9831eb0a7c0ef71856b, server=jenkins-hbase4.apache.org,38989,1689469866617 in 255 msec 2023-07-16 01:12:54,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:54,120 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=541d49516e3d9681e310d419f9500c73, regionState=CLOSED 2023-07-16 01:12:54,120 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469974120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469974120"}]},"ts":"1689469974120"} 2023-07-16 01:12:54,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8fe468fdf2fef9831eb0a7c0ef71856b, UNASSIGN in 266 msec 2023-07-16 01:12:54,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-16 01:12:54,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 541d49516e3d9681e310d419f9500c73, server=jenkins-hbase4.apache.org,46827,1689469866564 in 263 msec 2023-07-16 01:12:54,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-16 01:12:54,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=541d49516e3d9681e310d419f9500c73, UNASSIGN in 271 msec 2023-07-16 01:12:54,128 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469974128"}]},"ts":"1689469974128"} 2023-07-16 01:12:54,129 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-16 01:12:54,133 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-16 01:12:54,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 289 msec 2023-07-16 01:12:54,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 01:12:54,152 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-16 01:12:54,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,157 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,158 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,159 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,162 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,163 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,163 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,163 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 01:12:54,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 01:12:54,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 01:12:54,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 01:12:54,164 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,164 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:54,165 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,165 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:54,165 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,165 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:54,165 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,165 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:54,166 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:54,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 01:12:54,166 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:54,170 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/recovered.edits] 2023-07-16 01:12:54,170 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/recovered.edits] 2023-07-16 01:12:54,177 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/cf/5d25eceb53a7435c94e092f7f0d22a34 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/cf/5d25eceb53a7435c94e092f7f0d22a34 2023-07-16 01:12:54,178 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/cf/f6cf3ca615f24a3685cd6c0923aadd8a to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/cf/f6cf3ca615f24a3685cd6c0923aadd8a 2023-07-16 01:12:54,182 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73/recovered.edits/9.seqid 2023-07-16 01:12:54,183 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/541d49516e3d9681e310d419f9500c73 2023-07-16 01:12:54,186 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b/recovered.edits/9.seqid 2023-07-16 01:12:54,187 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8fe468fdf2fef9831eb0a7c0ef71856b 2023-07-16 01:12:54,187 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 01:12:54,188 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-16 01:12:54,188 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-16 01:12:54,194 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230716046e8712c7414b25b8b8b212636e70af to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230716046e8712c7414b25b8b8b212636e70af 2023-07-16 01:12:54,195 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d8890295a2ec4ebe99e72b54def0e168 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716d8890295a2ec4ebe99e72b54def0e168 2023-07-16 01:12:54,196 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-16 01:12:54,199 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,210 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-16 01:12:54,216 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-16 01:12:54,218 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,218 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-16 01:12:54,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469974218"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:54,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469974218"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:54,222 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:12:54,222 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8fe468fdf2fef9831eb0a7c0ef71856b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950520.8fe468fdf2fef9831eb0a7c0ef71856b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 541d49516e3d9681e310d419f9500c73, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950520.541d49516e3d9681e310d419f9500c73.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:12:54,222 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-16 01:12:54,222 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469974222"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:54,224 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-16 01:12:54,232 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 79 msec 2023-07-16 01:12:54,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 01:12:54,268 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-16 01:12:54,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 01:12:54,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 01:12:54,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:54,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-16 01:12:54,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:54,348 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 744) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:35709 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153529499_1 at /127.0.0.1:48742 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:48752 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:52490 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4107 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153529499_1 at /127.0.0.1:52456 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:59766 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 893) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=539 (was 438) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=2108 (was 2481) 2023-07-16 01:12:54,348 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-16 01:12:54,375 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=539, ProcessCount=184, AvailableMemoryMB=2106 2023-07-16 01:12:54,376 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-16 01:12:54,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 01:12:54,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:12:54,382 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:12:54,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-16 01:12:54,383 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:12:54,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 01:12:54,390 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:12:54,390 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:12:54,391 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492 empty. 2023-07-16 01:12:54,391 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37 empty. 2023-07-16 01:12:54,392 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:12:54,392 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:12:54,392 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 01:12:54,430 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 01:12:54,435 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e20791038008f10b33cc7f4a19f2a492, NAME => 'testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:12:54,437 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 79f114c946c9dd90b8f712f5fd7f2a37, NAME => 'testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:12:54,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 01:12:54,501 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:54,501 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 79f114c946c9dd90b8f712f5fd7f2a37, disabling compactions & flushes 2023-07-16 01:12:54,501 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:54,501 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:54,501 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. after waiting 0 ms 2023-07-16 01:12:54,501 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:54,501 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:54,501 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 79f114c946c9dd90b8f712f5fd7f2a37: 2023-07-16 01:12:54,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:54,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e20791038008f10b33cc7f4a19f2a492, disabling compactions & flushes 2023-07-16 01:12:54,504 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:54,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:54,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. after waiting 0 ms 2023-07-16 01:12:54,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:54,504 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:54,504 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e20791038008f10b33cc7f4a19f2a492: 2023-07-16 01:12:54,508 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:12:54,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469974509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469974509"}]},"ts":"1689469974509"} 2023-07-16 01:12:54,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469974509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469974509"}]},"ts":"1689469974509"} 2023-07-16 01:12:54,512 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:12:54,515 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:12:54,515 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469974515"}]},"ts":"1689469974515"} 2023-07-16 01:12:54,517 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 01:12:54,521 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:12:54,523 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:12:54,523 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:12:54,523 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:12:54,523 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:12:54,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e20791038008f10b33cc7f4a19f2a492, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79f114c946c9dd90b8f712f5fd7f2a37, ASSIGN}] 2023-07-16 01:12:54,528 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e20791038008f10b33cc7f4a19f2a492, ASSIGN 2023-07-16 01:12:54,529 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79f114c946c9dd90b8f712f5fd7f2a37, ASSIGN 2023-07-16 01:12:54,540 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79f114c946c9dd90b8f712f5fd7f2a37, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46827,1689469866564; forceNewPlan=false, retain=false 2023-07-16 01:12:54,540 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e20791038008f10b33cc7f4a19f2a492, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1689469866617; forceNewPlan=false, retain=false 2023-07-16 01:12:54,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 01:12:54,690 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:12:54,694 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=79f114c946c9dd90b8f712f5fd7f2a37, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:54,694 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469974694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469974694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469974694"}]},"ts":"1689469974694"} 2023-07-16 01:12:54,695 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e20791038008f10b33cc7f4a19f2a492, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:54,695 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469974695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469974695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469974695"}]},"ts":"1689469974695"} 2023-07-16 01:12:54,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 79f114c946c9dd90b8f712f5fd7f2a37, server=jenkins-hbase4.apache.org,46827,1689469866564}] 2023-07-16 01:12:54,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure e20791038008f10b33cc7f4a19f2a492, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:12:54,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:54,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e20791038008f10b33cc7f4a19f2a492, NAME => 'testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:12:54,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. service=AccessControlService 2023-07-16 01:12:54,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:54,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:12:54,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:54,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:12:54,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:12:54,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:54,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79f114c946c9dd90b8f712f5fd7f2a37, NAME => 'testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:12:54,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. service=AccessControlService 2023-07-16 01:12:54,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:54,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:12:54,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:54,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:12:54,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:12:54,903 INFO [StoreOpener-79f114c946c9dd90b8f712f5fd7f2a37-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:12:54,907 INFO [StoreOpener-e20791038008f10b33cc7f4a19f2a492-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:12:54,908 DEBUG [StoreOpener-79f114c946c9dd90b8f712f5fd7f2a37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/cf 2023-07-16 01:12:54,909 DEBUG [StoreOpener-79f114c946c9dd90b8f712f5fd7f2a37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/cf 2023-07-16 01:12:54,909 DEBUG [StoreOpener-e20791038008f10b33cc7f4a19f2a492-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/cf 2023-07-16 01:12:54,909 DEBUG [StoreOpener-e20791038008f10b33cc7f4a19f2a492-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/cf 2023-07-16 01:12:54,909 INFO [StoreOpener-79f114c946c9dd90b8f712f5fd7f2a37-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79f114c946c9dd90b8f712f5fd7f2a37 columnFamilyName cf 2023-07-16 01:12:54,909 INFO [StoreOpener-e20791038008f10b33cc7f4a19f2a492-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e20791038008f10b33cc7f4a19f2a492 columnFamilyName cf 2023-07-16 01:12:54,911 INFO [StoreOpener-e20791038008f10b33cc7f4a19f2a492-1] regionserver.HStore(310): Store=e20791038008f10b33cc7f4a19f2a492/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:54,912 INFO [StoreOpener-79f114c946c9dd90b8f712f5fd7f2a37-1] regionserver.HStore(310): Store=79f114c946c9dd90b8f712f5fd7f2a37/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:54,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:12:54,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:12:54,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:12:54,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:12:54,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:12:54,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:12:54,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:54,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e20791038008f10b33cc7f4a19f2a492; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71307417, jitterRate=0.06256331503391266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:54,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e20791038008f10b33cc7f4a19f2a492: 2023-07-16 01:12:54,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:54,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492., pid=94, masterSystemTime=1689469974849 2023-07-16 01:12:54,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79f114c946c9dd90b8f712f5fd7f2a37; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65107977, jitterRate=-0.029815539717674255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:54,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79f114c946c9dd90b8f712f5fd7f2a37: 2023-07-16 01:12:54,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37., pid=93, masterSystemTime=1689469974849 2023-07-16 01:12:54,944 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e20791038008f10b33cc7f4a19f2a492, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:54,944 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469974944"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469974944"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469974944"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469974944"}]},"ts":"1689469974944"} 2023-07-16 01:12:54,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:54,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:54,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:54,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:54,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=79f114c946c9dd90b8f712f5fd7f2a37, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:54,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469974948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469974948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469974948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469974948"}]},"ts":"1689469974948"} 2023-07-16 01:12:54,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-16 01:12:54,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure e20791038008f10b33cc7f4a19f2a492, server=jenkins-hbase4.apache.org,38989,1689469866617 in 251 msec 2023-07-16 01:12:54,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e20791038008f10b33cc7f4a19f2a492, ASSIGN in 429 msec 2023-07-16 01:12:54,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-16 01:12:54,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 79f114c946c9dd90b8f712f5fd7f2a37, server=jenkins-hbase4.apache.org,46827,1689469866564 in 261 msec 2023-07-16 01:12:54,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-16 01:12:54,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79f114c946c9dd90b8f712f5fd7f2a37, ASSIGN in 438 msec 2023-07-16 01:12:54,965 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:12:54,965 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469974965"}]},"ts":"1689469974965"} 2023-07-16 01:12:54,967 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 01:12:54,973 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:12:54,973 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-16 01:12:54,975 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:12:54,983 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:54,983 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:54,983 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:54,983 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:54,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:54,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:54,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:54,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:54,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 607 msec 2023-07-16 01:12:54,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 01:12:54,989 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-16 01:12:54,993 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 01:12:54,993 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:54,996 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:55,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:55,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469975022 (current time:1689469975022). 2023-07-16 01:12:55,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:55,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x19af5c30 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:55,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@142a3887, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:55,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:55,050 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:55,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19af5c30 to 127.0.0.1:55425 2023-07-16 01:12:55,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:55,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x05f92ed6 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:55,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66d4ac85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:55,083 DEBUG [hconnection-0x23ff5ed8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:55,086 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:55,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:55,093 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:55,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05f92ed6 to 127.0.0.1:55425 2023-07-16 01:12:55,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:55,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:12:55,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:55,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:55,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:55,100 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:55,101 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689470575101 2023-07-16 01:12:55,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:55,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 01:12:55,101 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:55,106 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:55,107 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:55,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:55,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-16 01:12:55,111 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:55,112 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689470575112 2023-07-16 01:12:55,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,142 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-16 01:12:55,143 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:55,144 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 01:12:55,144 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 01:12:55,146 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,147 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,153 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,153 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,153 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,153 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 01:12:55,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 01:12:55,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,155 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:55,155 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:55,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,159 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:55,159 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:55,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:55,164 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,164 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:55,166 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:55,166 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:55,166 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:55,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,166 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,166 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:55,167 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,167 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 01:12:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,171 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:55,171 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,171 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,171 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,172 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,172 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:55,173 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,174 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:55,174 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:55,172 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:55,174 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,177 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,177 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 01:12:55,177 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e92fa3a[Count = 1] remaining members to acquire global barrier 2023-07-16 01:12:55,177 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 01:12:55,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e92fa3a[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:55,182 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 01:12:55,182 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,184 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,184 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,184 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,184 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:55,184 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,184 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:55,184 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:55,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,184 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,185 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. started... 2023-07-16 01:12:55,185 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:55,185 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:55,185 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:55,185 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e20791038008f10b33cc7f4a19f2a492: 2023-07-16 01:12:55,185 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,185 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:55,185 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,185 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:12:55,185 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:55,185 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:12:55,188 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:55,188 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:55,188 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:55,190 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:55,206 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:55,204 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:55,206 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. started... 2023-07-16 01:12:55,206 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:55,208 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79f114c946c9dd90b8f712f5fd7f2a37: 2023-07-16 01:12:55,208 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,208 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:55,208 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:12:55,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:55,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:55,209 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:55,227 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. completed. 2023-07-16 01:12:55,227 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:12:55,230 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:55,230 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,230 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,230 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,236 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. completed. 2023-07-16 01:12:55,236 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:55,236 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:55,236 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:55,236 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,236 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:55,236 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:12:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,239 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,239 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:55,239 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,239 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:12:55,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 01:12:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46827,1689469866564': 2023-07-16 01:12:55,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 01:12:55,246 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 01:12:55,246 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:55,246 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:55,246 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,246 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:55,249 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,249 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,249 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,249 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,249 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,250 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,249 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,250 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,251 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,251 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,256 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,256 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,257 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,261 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,261 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,261 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,261 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,261 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:55,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,261 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,261 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,261 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-16 01:12:55,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:12:55,263 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,264 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,264 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,264 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,264 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,264 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,264 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,264 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,264 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,264 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 01:12:55,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 01:12:55,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,378 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689469975101Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689469975285 (+184 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689469975285Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689469975286 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689469975297 (+11 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689469975330 (+33 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689469975377 (+47 ms) 2023-07-16 01:12:55,381 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:55,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 280 msec 2023-07-16 01:12:55,409 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:55,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:55,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:55,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38989] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:12:55,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46827] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:12:55,419 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 01:12:55,419 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:55,419 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:55,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:55,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469975431 (current time:1689469975431). 2023-07-16 01:12:55,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:55,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x68dd87bd to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:55,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@310d0de0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:55,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:55,467 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:55,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68dd87bd to 127.0.0.1:55425 2023-07-16 01:12:55,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:55,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x65f717b7 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:55,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@611394db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:55,481 DEBUG [hconnection-0x3828f714-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:55,482 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:55,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:55,489 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65f717b7 to 127.0.0.1:55425 2023-07-16 01:12:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:12:55,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:55,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:55,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:55,496 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:55,497 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689470575497 2023-07-16 01:12:55,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:55,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 01:12:55,499 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:55,499 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:55,500 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:55,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:55,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-16 01:12:55,503 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:55,504 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689470575503 2023-07-16 01:12:55,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,519 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-16 01:12:55,520 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:55,521 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 01:12:55,521 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 01:12:55,521 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,522 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,523 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,523 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,523 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,523 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,523 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,523 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,524 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,524 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:55,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 01:12:55,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,525 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:55,525 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:55,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,525 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:55,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,525 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:55,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,525 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:55,536 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:55,536 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:55,536 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:55,537 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:55,538 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:55,536 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:55,538 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:55,538 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:55,542 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:55,542 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:55,543 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:55,543 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:55,545 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,545 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,546 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,546 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,546 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,546 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,546 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:55,547 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,547 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,547 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:55,547 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 01:12:55,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f274983[Count = 1] remaining members to acquire global barrier 2023-07-16 01:12:55,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 01:12:55,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f274983[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:55,552 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 01:12:55,553 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,557 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:55,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,557 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:55,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,557 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:55,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,558 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:55,558 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:55,558 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. started... 2023-07-16 01:12:55,558 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. started... 2023-07-16 01:12:55,558 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:55,558 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e20791038008f10b33cc7f4a19f2a492 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-16 01:12:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:12:55,558 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 79f114c946c9dd90b8f712f5fd7f2a37 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-16 01:12:55,561 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:55,561 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:55,561 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:55,597 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071633e327e0b590492693c56f74b648eb63 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071633e327e0b590492693c56f74b648eb63 2023-07-16 01:12:55,599 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:55,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:55,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:55,601 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:55,602 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716f766f5085b03455b9c7e11ab8da00d6f to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716f766f5085b03455b9c7e11ab8da00d6f 2023-07-16 01:12:55,643 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/.tmp/cf/23eb6dd0d4eb4e06b535da605db6ab58 2023-07-16 01:12:55,644 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/.tmp/cf/ccb7cf473a1f4ae9a0742f208c42c806 2023-07-16 01:12:55,650 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/.tmp/cf/23eb6dd0d4eb4e06b535da605db6ab58 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/cf/23eb6dd0d4eb4e06b535da605db6ab58 2023-07-16 01:12:55,652 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/.tmp/cf/ccb7cf473a1f4ae9a0742f208c42c806 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/cf/ccb7cf473a1f4ae9a0742f208c42c806 2023-07-16 01:12:55,657 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/cf/23eb6dd0d4eb4e06b535da605db6ab58, entries=46, sequenceid=6, filesize=12.9 K 2023-07-16 01:12:55,658 INFO [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 79f114c946c9dd90b8f712f5fd7f2a37 in 100ms, sequenceid=6, compaction requested=false 2023-07-16 01:12:55,658 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-16 01:12:55,658 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/cf/ccb7cf473a1f4ae9a0742f208c42c806, entries=4, sequenceid=6, filesize=5.6 K 2023-07-16 01:12:55,659 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for e20791038008f10b33cc7f4a19f2a492 in 101ms, sequenceid=6, compaction requested=false 2023-07-16 01:12:55,659 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79f114c946c9dd90b8f712f5fd7f2a37: 2023-07-16 01:12:55,661 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e20791038008f10b33cc7f4a19f2a492: 2023-07-16 01:12:55,661 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,661 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,661 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:55,661 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:55,661 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/cf/23eb6dd0d4eb4e06b535da605db6ab58] hfiles 2023-07-16 01:12:55,661 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/cf/ccb7cf473a1f4ae9a0742f208c42c806] hfiles 2023-07-16 01:12:55,661 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/cf/ccb7cf473a1f4ae9a0742f208c42c806 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,661 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/cf/23eb6dd0d4eb4e06b535da605db6ab58 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,710 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. completed. 2023-07-16 01:12:55,710 DEBUG [rs(jenkins-hbase4.apache.org,46827,1689469866564)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:12:55,710 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:55,710 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:55,710 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,710 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:55,710 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:12:55,712 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,712 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:55,712 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:55,712 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,716 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. completed. 2023-07-16 01:12:55,716 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:12:55,716 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:55,717 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:55,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,717 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,717 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:55,717 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:12:55,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:55,719 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,719 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:55,719 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:55,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46827,1689469866564': 2023-07-16 01:12:55,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 01:12:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:12:55,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 01:12:55,727 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 01:12:55,727 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:55,727 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:55,727 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,727 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:55,730 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,730 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,730 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,730 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,730 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:55,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:55,732 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,732 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:55,732 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:55,734 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,734 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,735 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,736 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,736 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,740 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:55,740 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,741 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-16 01:12:55,741 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:12:55,743 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716f766f5085b03455b9c7e11ab8da00d6f, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071633e327e0b590492693c56f74b648eb63] mob files 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716f766f5085b03455b9c7e11ab8da00d6f 2023-07-16 01:12:55,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071633e327e0b590492693c56f74b648eb63 2023-07-16 01:12:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,745 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:12:55,745 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:12:55,745 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,745 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,744 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:55,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:55,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:55,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,801 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:55,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:55,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:55,803 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:12:55,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 01:12:55,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,915 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:55,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689469975497Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689469975763 (+266 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689469975763Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689469975763Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689469975769 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689469975820 (+51 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689469975914 (+94 ms) 2023-07-16 01:12:55,918 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:55,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 420 msec 2023-07-16 01:12:56,103 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:56,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:56,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:56,104 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104 2023-07-16 01:12:56,105 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35755, tgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104, rawTgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104, srcFsUri=hdfs://localhost:35755, srcDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:12:56,131 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:12:56,131 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2093760978_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:56,131 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660, snapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-16 01:12:56,148 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:56,174 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:56,175 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:56,176 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:56,176 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:57,310 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-4449316523082688762.jar 2023-07-16 01:12:57,310 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:57,311 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:57,440 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-129671235384947718.jar 2023-07-16 01:12:57,440 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:57,441 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:57,441 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:57,441 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:57,442 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:57,442 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:57,442 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:12:57,443 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:12:57,443 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:12:57,443 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:12:57,444 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:12:57,444 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:12:57,444 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:12:57,445 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:12:57,445 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:12:57,446 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:12:57,447 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:57,447 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:57,448 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:57,448 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:57,448 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:57,449 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:57,450 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:57,644 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:58,918 WARN [Listener at jenkins-hbase4.apache.org/32773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:12:58,921 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-16 01:12:59,078 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:59,078 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:59,212 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0006_000001 (auth:SIMPLE) 2023-07-16 01:12:59,219 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:13:06,088 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0006_000001 (auth:SIMPLE) 2023-07-16 01:13:08,432 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:13:08,433 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:13:08,440 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:08,440 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:13:08,440 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:13:08,441 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:08,441 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 01:13:08,441 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 01:13:08,441 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:08,442 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 01:13:08,442 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469976104/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 01:13:08,448 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469988455"}]},"ts":"1689469988455"} 2023-07-16 01:13:08,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 01:13:08,457 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 01:13:08,459 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-16 01:13:08,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e20791038008f10b33cc7f4a19f2a492, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79f114c946c9dd90b8f712f5fd7f2a37, UNASSIGN}] 2023-07-16 01:13:08,465 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e20791038008f10b33cc7f4a19f2a492, UNASSIGN 2023-07-16 01:13:08,465 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79f114c946c9dd90b8f712f5fd7f2a37, UNASSIGN 2023-07-16 01:13:08,466 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e20791038008f10b33cc7f4a19f2a492, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:08,466 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=79f114c946c9dd90b8f712f5fd7f2a37, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:08,466 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469988466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469988466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469988466"}]},"ts":"1689469988466"} 2023-07-16 01:13:08,466 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469988466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469988466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469988466"}]},"ts":"1689469988466"} 2023-07-16 01:13:08,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure e20791038008f10b33cc7f4a19f2a492, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:13:08,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 79f114c946c9dd90b8f712f5fd7f2a37, server=jenkins-hbase4.apache.org,46827,1689469866564}] 2023-07-16 01:13:08,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 01:13:08,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:13:08,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e20791038008f10b33cc7f4a19f2a492, disabling compactions & flushes 2023-07-16 01:13:08,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:13:08,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:13:08,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. after waiting 0 ms 2023-07-16 01:13:08,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:13:08,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:13:08,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79f114c946c9dd90b8f712f5fd7f2a37, disabling compactions & flushes 2023-07-16 01:13:08,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:13:08,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:13:08,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. after waiting 0 ms 2023-07-16 01:13:08,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:13:08,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:08,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:08,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492. 2023-07-16 01:13:08,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e20791038008f10b33cc7f4a19f2a492: 2023-07-16 01:13:08,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:13:08,643 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e20791038008f10b33cc7f4a19f2a492, regionState=CLOSED 2023-07-16 01:13:08,643 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469988643"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469988643"}]},"ts":"1689469988643"} 2023-07-16 01:13:08,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:08,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:08,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37. 2023-07-16 01:13:08,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79f114c946c9dd90b8f712f5fd7f2a37: 2023-07-16 01:13:08,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-16 01:13:08,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure e20791038008f10b33cc7f4a19f2a492, server=jenkins-hbase4.apache.org,38989,1689469866617 in 175 msec 2023-07-16 01:13:08,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:13:08,652 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=79f114c946c9dd90b8f712f5fd7f2a37, regionState=CLOSED 2023-07-16 01:13:08,652 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469988652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469988652"}]},"ts":"1689469988652"} 2023-07-16 01:13:08,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e20791038008f10b33cc7f4a19f2a492, UNASSIGN in 191 msec 2023-07-16 01:13:08,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-16 01:13:08,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 79f114c946c9dd90b8f712f5fd7f2a37, server=jenkins-hbase4.apache.org,46827,1689469866564 in 176 msec 2023-07-16 01:13:08,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-16 01:13:08,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79f114c946c9dd90b8f712f5fd7f2a37, UNASSIGN in 196 msec 2023-07-16 01:13:08,658 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469988658"}]},"ts":"1689469988658"} 2023-07-16 01:13:08,659 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 01:13:08,661 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-16 01:13:08,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 213 msec 2023-07-16 01:13:08,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 01:13:08,758 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-16 01:13:08,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,763 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,763 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,764 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,767 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:13:08,767 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:13:08,768 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,768 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,768 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,768 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,768 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 01:13:08,768 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 01:13:08,769 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 01:13:08,769 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,769 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:08,769 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:08,770 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,769 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,769 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-16 01:13:08,770 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:08,770 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:08,770 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:13:08,770 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/recovered.edits] 2023-07-16 01:13:08,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 01:13:08,770 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/recovered.edits] 2023-07-16 01:13:08,774 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/cf/ccb7cf473a1f4ae9a0742f208c42c806 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/cf/ccb7cf473a1f4ae9a0742f208c42c806 2023-07-16 01:13:08,774 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/cf/23eb6dd0d4eb4e06b535da605db6ab58 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/cf/23eb6dd0d4eb4e06b535da605db6ab58 2023-07-16 01:13:08,777 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492/recovered.edits/9.seqid 2023-07-16 01:13:08,777 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37/recovered.edits/9.seqid 2023-07-16 01:13:08,778 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/e20791038008f10b33cc7f4a19f2a492 2023-07-16 01:13:08,778 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testEmptyExportFileSystemState/79f114c946c9dd90b8f712f5fd7f2a37 2023-07-16 01:13:08,778 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 01:13:08,778 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-16 01:13:08,779 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-16 01:13:08,783 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716f766f5085b03455b9c7e11ab8da00d6f to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230716f766f5085b03455b9c7e11ab8da00d6f 2023-07-16 01:13:08,785 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071633e327e0b590492693c56f74b648eb63 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071633e327e0b590492693c56f74b648eb63 2023-07-16 01:13:08,786 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-16 01:13:08,788 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,790 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-16 01:13:08,792 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-16 01:13:08,793 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,793 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-16 01:13:08,793 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469988793"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:08,793 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469988793"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:08,795 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:13:08,795 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e20791038008f10b33cc7f4a19f2a492, NAME => 'testtb-testEmptyExportFileSystemState,,1689469974377.e20791038008f10b33cc7f4a19f2a492.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 79f114c946c9dd90b8f712f5fd7f2a37, NAME => 'testtb-testEmptyExportFileSystemState,1,1689469974377.79f114c946c9dd90b8f712f5fd7f2a37.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:13:08,795 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-16 01:13:08,795 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469988795"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:08,796 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-16 01:13:08,798 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:08,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-07-16 01:13:08,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 01:13:08,872 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-16 01:13:08,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-16 01:13:08,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:08,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-16 01:13:08,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:08,912 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:54008 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:42501 from appattempt_1689469875797_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:32773 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-15337427_1 at /127.0.0.1:53976 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:34354 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4793 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-15337427_1 at /127.0.0.1:34326 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:34289 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1099964093_17 at /127.0.0.1:59386 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c9ebafe-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=532 (was 539), ProcessCount=184 (was 184), AvailableMemoryMB=1718 (was 2106) 2023-07-16 01:13:08,913 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-16 01:13:08,934 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=532, ProcessCount=184, AvailableMemoryMB=1717 2023-07-16 01:13:08,934 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-16 01:13:08,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 01:13:08,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,940 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:13:08,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-16 01:13:08,940 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:13:08,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 01:13:08,943 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:08,943 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:08,944 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8 empty. 2023-07-16 01:13:08,944 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349 empty. 2023-07-16 01:13:08,944 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:08,944 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:08,944 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 01:13:08,953 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-16 01:13:08,954 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => a31ad385ec1dde90564bfca7f4c25ca8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:13:08,955 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 374d93859dac3abb33b34fca929ac349, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing a31ad385ec1dde90564bfca7f4c25ca8, disabling compactions & flushes 2023-07-16 01:13:08,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. after waiting 0 ms 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 374d93859dac3abb33b34fca929ac349, disabling compactions & flushes 2023-07-16 01:13:08,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:08,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for a31ad385ec1dde90564bfca7f4c25ca8: 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. after waiting 0 ms 2023-07-16 01:13:08,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:08,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:08,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 374d93859dac3abb33b34fca929ac349: 2023-07-16 01:13:08,969 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:13:08,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469988970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469988970"}]},"ts":"1689469988970"} 2023-07-16 01:13:08,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469988970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469988970"}]},"ts":"1689469988970"} 2023-07-16 01:13:08,973 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:13:08,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:13:08,973 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469988973"}]},"ts":"1689469988973"} 2023-07-16 01:13:08,975 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-16 01:13:08,978 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:13:08,979 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:13:08,980 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:13:08,980 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:13:08,980 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:13:08,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a31ad385ec1dde90564bfca7f4c25ca8, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=374d93859dac3abb33b34fca929ac349, ASSIGN}] 2023-07-16 01:13:08,982 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a31ad385ec1dde90564bfca7f4c25ca8, ASSIGN 2023-07-16 01:13:08,982 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=374d93859dac3abb33b34fca929ac349, ASSIGN 2023-07-16 01:13:08,983 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a31ad385ec1dde90564bfca7f4c25ca8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1689469866617; forceNewPlan=false, retain=false 2023-07-16 01:13:08,983 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=374d93859dac3abb33b34fca929ac349, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41771,1689469866681; forceNewPlan=false, retain=false 2023-07-16 01:13:09,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 01:13:09,133 INFO [jenkins-hbase4:34911] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:13:09,136 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a31ad385ec1dde90564bfca7f4c25ca8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,136 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=374d93859dac3abb33b34fca929ac349, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,137 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469989136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469989136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469989136"}]},"ts":"1689469989136"} 2023-07-16 01:13:09,137 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469989136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469989136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469989136"}]},"ts":"1689469989136"} 2023-07-16 01:13:09,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure a31ad385ec1dde90564bfca7f4c25ca8, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:13:09,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 374d93859dac3abb33b34fca929ac349, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:13:09,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 01:13:09,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:09,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:09,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a31ad385ec1dde90564bfca7f4c25ca8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:13:09,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 374d93859dac3abb33b34fca929ac349, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:13:09,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. service=AccessControlService 2023-07-16 01:13:09,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. service=AccessControlService 2023-07-16 01:13:09,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:13:09,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:13:09,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:09,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:09,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:13:09,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:13:09,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:09,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:09,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:09,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:09,298 INFO [StoreOpener-374d93859dac3abb33b34fca929ac349-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:09,300 INFO [StoreOpener-a31ad385ec1dde90564bfca7f4c25ca8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:09,301 DEBUG [StoreOpener-374d93859dac3abb33b34fca929ac349-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/cf 2023-07-16 01:13:09,302 DEBUG [StoreOpener-a31ad385ec1dde90564bfca7f4c25ca8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/cf 2023-07-16 01:13:09,302 DEBUG [StoreOpener-a31ad385ec1dde90564bfca7f4c25ca8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/cf 2023-07-16 01:13:09,302 DEBUG [StoreOpener-374d93859dac3abb33b34fca929ac349-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/cf 2023-07-16 01:13:09,302 INFO [StoreOpener-a31ad385ec1dde90564bfca7f4c25ca8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a31ad385ec1dde90564bfca7f4c25ca8 columnFamilyName cf 2023-07-16 01:13:09,302 INFO [StoreOpener-374d93859dac3abb33b34fca929ac349-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 374d93859dac3abb33b34fca929ac349 columnFamilyName cf 2023-07-16 01:13:09,304 INFO [StoreOpener-374d93859dac3abb33b34fca929ac349-1] regionserver.HStore(310): Store=374d93859dac3abb33b34fca929ac349/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:13:09,304 INFO [StoreOpener-a31ad385ec1dde90564bfca7f4c25ca8-1] regionserver.HStore(310): Store=a31ad385ec1dde90564bfca7f4c25ca8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:13:09,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:09,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:09,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:09,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:09,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:09,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:09,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:13:09,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 374d93859dac3abb33b34fca929ac349; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68999242, jitterRate=0.028168827295303345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:13:09,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:13:09,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 374d93859dac3abb33b34fca929ac349: 2023-07-16 01:13:09,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a31ad385ec1dde90564bfca7f4c25ca8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61706105, jitterRate=-0.08050738275051117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:13:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a31ad385ec1dde90564bfca7f4c25ca8: 2023-07-16 01:13:09,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349., pid=109, masterSystemTime=1689469989290 2023-07-16 01:13:09,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8., pid=108, masterSystemTime=1689469989290 2023-07-16 01:13:09,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:09,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:09,315 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=374d93859dac3abb33b34fca929ac349, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:09,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:09,315 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469989314"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469989314"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469989314"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469989314"}]},"ts":"1689469989314"} 2023-07-16 01:13:09,316 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a31ad385ec1dde90564bfca7f4c25ca8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,316 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469989315"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469989315"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469989315"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469989315"}]},"ts":"1689469989315"} 2023-07-16 01:13:09,319 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-16 01:13:09,319 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 374d93859dac3abb33b34fca929ac349, server=jenkins-hbase4.apache.org,41771,1689469866681 in 178 msec 2023-07-16 01:13:09,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-16 01:13:09,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure a31ad385ec1dde90564bfca7f4c25ca8, server=jenkins-hbase4.apache.org,38989,1689469866617 in 180 msec 2023-07-16 01:13:09,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=374d93859dac3abb33b34fca929ac349, ASSIGN in 339 msec 2023-07-16 01:13:09,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-16 01:13:09,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a31ad385ec1dde90564bfca7f4c25ca8, ASSIGN in 339 msec 2023-07-16 01:13:09,322 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:13:09,322 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469989322"}]},"ts":"1689469989322"} 2023-07-16 01:13:09,324 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-16 01:13:09,326 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:13:09,326 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-16 01:13:09,328 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 01:13:09,329 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:09,329 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:09,329 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:09,329 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:09,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 01:13:09,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 01:13:09,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 01:13:09,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 01:13:09,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 394 msec 2023-07-16 01:13:09,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 01:13:09,545 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-16 01:13:09,548 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,548 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:09,550 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:13:09,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:09,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469989562 (current time:1689469989562). 2023-07-16 01:13:09,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:13:09,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x7faa6563 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:13:09,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33851987, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:13:09,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:09,583 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:09,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7faa6563 to 127.0.0.1:55425 2023-07-16 01:13:09,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:09,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x60cde595 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:13:09,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ce01592, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:13:09,592 DEBUG [hconnection-0x57b264a8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:09,596 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:09,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:09,604 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:09,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60cde595 to 127.0.0.1:55425 2023-07-16 01:13:09,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:09,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 01:13:09,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:13:09,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:09,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:09,610 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:09,611 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689470589611 2023-07-16 01:13:09,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:09,612 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:13:09,612 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:13:09,614 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:09,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:09,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-16 01:13:09,616 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:09,617 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689470589616 2023-07-16 01:13:09,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,626 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 01:13:09,626 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:09,627 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 01:13:09,627 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 01:13:09,628 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,628 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,631 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:09,631 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:09,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:09,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:09,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:09,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:09,631 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:09,631 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:09,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:09,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,631 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,631 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,632 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,632 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:09,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,632 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:09,633 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:09,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,634 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:09,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,634 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:09,634 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:09,634 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:09,634 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:09,635 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:09,635 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:09,634 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:09,636 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:09,636 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:09,635 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:09,636 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:09,636 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:09,642 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,642 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:09,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:09,643 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,644 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:09,644 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:09,644 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:09,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:09,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,645 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,646 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,646 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:09,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:09,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 01:13:09,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e398946[Count = 1] remaining members to acquire global barrier 2023-07-16 01:13:09,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:09,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:09,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:09,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:09,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:09,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:09,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 01:13:09,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e398946[Count = 0] remaining members to acquire global barrier 2023-07-16 01:13:09,651 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 01:13:09,651 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,652 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,652 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,653 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:09,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,653 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:09,653 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:09,653 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:13:09,653 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:13:09,653 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:13:09,653 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:09,653 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. started... 2023-07-16 01:13:09,655 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 374d93859dac3abb33b34fca929ac349: 2023-07-16 01:13:09,655 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,655 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:13:09,655 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:13:09,657 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,658 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:09,658 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,658 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:13:09,658 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:13:09,658 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:09,659 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. started... 2023-07-16 01:13:09,659 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,659 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:13:09,659 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a31ad385ec1dde90564bfca7f4c25ca8: 2023-07-16 01:13:09,659 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,659 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:13:09,659 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:13:09,661 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:09,661 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:09,661 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:09,693 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. completed. 2023-07-16 01:13:09,693 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:09,693 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:13:09,693 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:13:09,693 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,694 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:09,694 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:13:09,696 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:09,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:09,697 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:09,697 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:09,697 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:09,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:09,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:09,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:09,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:09,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:09,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:09,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:09,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41771,1689469866681': 2023-07-16 01:13:09,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 01:13:09,712 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:09,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:09,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:13:09,714 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:13:09,914 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:09,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:09,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:13:09,918 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:13:10,097 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. completed. 2023-07-16 01:13:10,097 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:10,097 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:13:10,098 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:13:10,098 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,098 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:10,098 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:13:10,100 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,100 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:10,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:10,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:10,100 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:10,100 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:10,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:13:10,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 01:13:10,106 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 01:13:10,106 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:13:10,106 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:13:10,106 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,106 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:13:10,108 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,108 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,108 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:10,108 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,108 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:10,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,109 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,108 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:10,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:10,109 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:10,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:10,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,110 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:10,111 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:10,113 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,114 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,114 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,127 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:10,127 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:10,127 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:10,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:10,127 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,127 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:10,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:10,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:10,127 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:10,128 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:10,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:10,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:10,127 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:10,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,130 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,128 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:10,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:10,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:10,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:13:10,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:10,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:10,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:10,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:10,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 01:13:10,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,218 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:10,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:10,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:13:10,220 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 01:13:10,240 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 01:13:10,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,240 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689469989611Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689469990166 (+555 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689469990166Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689469990166Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689469990177 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689469990193 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689469990240 (+47 ms) 2023-07-16 01:13:10,243 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:10,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 631 msec 2023-07-16 01:13:10,720 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:10,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:10,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:13:10,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38989] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:13:10,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41771] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:13:10,729 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,729 DEBUG [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:10,729 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:13:10,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:10,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469990746 (current time:1689469990746). 2023-07-16 01:13:10,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:13:10,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x37f30158 to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:13:10,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7320b42a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:13:10,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:10,762 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:10,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37f30158 to 127.0.0.1:55425 2023-07-16 01:13:10,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:10,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(139): Connect 0x0926217e to 127.0.0.1:55425 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:13:10,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@267018c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:13:10,774 DEBUG [hconnection-0x508769c3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:10,778 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:10,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:10,786 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:10,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0926217e to 127.0.0.1:55425 2023-07-16 01:13:10,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:10,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 01:13:10,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:13:10,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:10,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:10,792 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:10,792 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689470590792 2023-07-16 01:13:10,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:10,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,794 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:13:10,794 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:13:10,795 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:10,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:10,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-16 01:13:10,799 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:10,800 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689470590800 2023-07-16 01:13:10,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,811 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 01:13:10,811 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:10,812 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 01:13:10,812 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 01:13:10,813 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,813 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,815 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:10,815 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:10,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:10,815 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:10,815 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:10,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:10,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:10,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:10,816 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,816 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,817 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,817 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:13:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 01:13:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 01:13:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 01:13:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:10,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:10,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:10,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,818 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:10,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,818 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:10,818 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:10,818 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:10,818 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:10,818 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:10,820 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:10,820 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:10,820 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:10,820 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:10,821 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:10,821 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:10,821 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:10,821 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46827,1689469866564' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:10,821 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:10,823 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,823 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,823 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,823 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:10,823 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,824 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,824 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:10,824 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,824 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:10,824 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,824 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:10,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41771,1689469866681' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 01:13:10,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@732eb957[Count = 1] remaining members to acquire global barrier 2023-07-16 01:13:10,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:10,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:10,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:10,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:10,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:10,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1689469866617' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 01:13:10,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@732eb957[Count = 0] remaining members to acquire global barrier 2023-07-16 01:13:10,828 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 01:13:10,828 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,835 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,835 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,835 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:10,836 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:13:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:10,836 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:10,836 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,836 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. started... 2023-07-16 01:13:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:13:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:10,836 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:13:10,836 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46827,1689469866564' in zk 2023-07-16 01:13:10,836 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 374d93859dac3abb33b34fca929ac349 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-16 01:13:10,837 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:13:10,837 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:13:10,837 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:10,837 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. started... 2023-07-16 01:13:10,837 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a31ad385ec1dde90564bfca7f4c25ca8 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-16 01:13:10,839 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:10,839 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:10,839 DEBUG [member: 'jenkins-hbase4.apache.org,46827,1689469866564' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:10,876 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307169e25819530b640ff84cdd1671f5b5e14 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307169e25819530b640ff84cdd1671f5b5e14 2023-07-16 01:13:10,877 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716ec600e904017442cb5069effd6d27198 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716ec600e904017442cb5069effd6d27198 2023-07-16 01:13:10,894 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:10,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:10,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:13:10,897 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:13:10,923 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/.tmp/cf/a579d1a860a543a788c48bebf52094b8 2023-07-16 01:13:10,926 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/.tmp/cf/180f68099e024e60bc7a34f7e25d4424 2023-07-16 01:13:10,929 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/.tmp/cf/a579d1a860a543a788c48bebf52094b8 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/cf/a579d1a860a543a788c48bebf52094b8 2023-07-16 01:13:10,931 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/.tmp/cf/180f68099e024e60bc7a34f7e25d4424 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/cf/180f68099e024e60bc7a34f7e25d4424 2023-07-16 01:13:10,938 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/cf/180f68099e024e60bc7a34f7e25d4424, entries=1, sequenceid=6, filesize=5.1 K 2023-07-16 01:13:10,939 INFO [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for a31ad385ec1dde90564bfca7f4c25ca8 in 102ms, sequenceid=6, compaction requested=false 2023-07-16 01:13:10,939 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-16 01:13:10,940 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a31ad385ec1dde90564bfca7f4c25ca8: 2023-07-16 01:13:10,940 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,940 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:13:10,940 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/cf/180f68099e024e60bc7a34f7e25d4424] hfiles 2023-07-16 01:13:10,941 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/cf/180f68099e024e60bc7a34f7e25d4424 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,944 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/cf/a579d1a860a543a788c48bebf52094b8, entries=49, sequenceid=6, filesize=13.7 K 2023-07-16 01:13:10,953 INFO [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 374d93859dac3abb33b34fca929ac349 in 117ms, sequenceid=6, compaction requested=false 2023-07-16 01:13:10,956 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 374d93859dac3abb33b34fca929ac349: 2023-07-16 01:13:10,957 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,957 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:13:10,957 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/cf/a579d1a860a543a788c48bebf52094b8] hfiles 2023-07-16 01:13:10,957 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/cf/a579d1a860a543a788c48bebf52094b8 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,980 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. completed. 2023-07-16 01:13:10,980 DEBUG [rs(jenkins-hbase4.apache.org,38989,1689469866617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:10,980 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:13:10,980 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:13:10,980 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,980 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:10,980 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38989,1689469866617' in zk 2023-07-16 01:13:10,982 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:10,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:10,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1689469866617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:10,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:10,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:10,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:10,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,991 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. completed. 2023-07-16 01:13:10,991 DEBUG [rs(jenkins-hbase4.apache.org,41771,1689469866681)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:13:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:13:10,992 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,992 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:10,992 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41771,1689469866681' in zk 2023-07-16 01:13:10,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38989,1689469866617': 2023-07-16 01:13:10,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1689469866617' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 01:13:10,993 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:10,993 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,993 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:10,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:10,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:10,993 DEBUG [member: 'jenkins-hbase4.apache.org,41771,1689469866681' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:10,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:10,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:10,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:10,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:10,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41771,1689469866681': 2023-07-16 01:13:10,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41771,1689469866681' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 01:13:10,999 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 01:13:10,999 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:13:10,999 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:13:10,999 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:10,999 INFO [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:13:11,001 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:11,001 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:11,001 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:11,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:11,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,002 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:11,003 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:11,007 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:11,007 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:11,008 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:11,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:11,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:11,013 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:11,013 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:11,013 DEBUG [(jenkins-hbase4.apache.org,34911,1689469864893)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:11,012 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:11,013 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:11,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 01:13:11,013 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,015 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:11,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:11,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:11,015 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:11,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716ec600e904017442cb5069effd6d27198, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307169e25819530b640ff84cdd1671f5b5e14] mob files 2023-07-16 01:13:11,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716ec600e904017442cb5069effd6d27198 2023-07-16 01:13:11,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:11,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:11,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307169e25819530b640ff84cdd1671f5b5e14 2023-07-16 01:13:11,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 01:13:11,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,071 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689469990793Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689469991023 (+230 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689469991023Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689469991023Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689469991026 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689469991035 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689469991070 (+35 ms) 2023-07-16 01:13:11,074 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:11,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 280 msec 2023-07-16 01:13:11,097 DEBUG [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:11,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:11,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:13:11,099 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099 2023-07-16 01:13:11,099 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35755, tgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099, rawTgtDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099, srcFsUri=hdfs://localhost:35755, srcDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:13:11,126 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660 2023-07-16 01:13:11,126 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181354981_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,126 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35755, inputRoot=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660, snapshotDir=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-16 01:13:11,135 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:11,174 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,174 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,175 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,175 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:12,320 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-15986028233699509.jar 2023-07-16 01:13:12,321 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:12,322 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:12,407 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/hadoop-6648907159754598255.jar 2023-07-16 01:13:12,408 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:12,408 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:12,409 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:12,410 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:12,410 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:12,410 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:12,411 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:13:12,411 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:13:12,411 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:13:12,412 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:13:12,412 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:13:12,413 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:13:12,413 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:13:12,414 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:13:12,414 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:13:12,415 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:13:12,416 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:13:12,417 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:13:12,417 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:13:12,418 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:13:12,418 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:13:12,418 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:13:12,419 DEBUG [Listener at jenkins-hbase4.apache.org/32773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:13:13,556 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0006_000001 (auth:SIMPLE) 2023-07-16 01:13:13,565 WARN [Listener at jenkins-hbase4.apache.org/32773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:13:13,568 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-16 01:13:13,570 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-16 01:13:13,670 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:13:13,670 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:13:14,264 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:13:14,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0007_000001 (auth:SIMPLE) 2023-07-16 01:13:20,925 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0007_000001 (auth:SIMPLE) 2023-07-16 01:13:23,321 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0007_000001 (auth:SIMPLE) 2023-07-16 01:13:27,424 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875797_0007_000001 (auth:SIMPLE) 2023-07-16 01:13:28,889 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:13:28,889 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:13:28,900 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:28,901 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:13:28,901 INFO [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:13:28,901 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:28,902 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 01:13:28,902 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 01:13:28,902 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099964093_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:28,902 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 01:13:28,902 DEBUG [Listener at jenkins-hbase4.apache.org/32773] snapshot.TestExportSnapshot(367): hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/export-test/export-1689469991099/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 01:13:28,908 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:28,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:28,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:28,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 01:13:28,920 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689470008920"}]},"ts":"1689470008920"} 2023-07-16 01:13:28,922 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-16 01:13:28,926 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-16 01:13:28,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a31ad385ec1dde90564bfca7f4c25ca8, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=374d93859dac3abb33b34fca929ac349, UNASSIGN}] 2023-07-16 01:13:28,929 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a31ad385ec1dde90564bfca7f4c25ca8, UNASSIGN 2023-07-16 01:13:28,929 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=374d93859dac3abb33b34fca929ac349, UNASSIGN 2023-07-16 01:13:28,930 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a31ad385ec1dde90564bfca7f4c25ca8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:28,930 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=374d93859dac3abb33b34fca929ac349, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:28,930 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689470008930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689470008930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689470008930"}]},"ts":"1689470008930"} 2023-07-16 01:13:28,930 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689470008930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689470008930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689470008930"}]},"ts":"1689470008930"} 2023-07-16 01:13:28,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure a31ad385ec1dde90564bfca7f4c25ca8, server=jenkins-hbase4.apache.org,38989,1689469866617}] 2023-07-16 01:13:28,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 374d93859dac3abb33b34fca929ac349, server=jenkins-hbase4.apache.org,41771,1689469866681}] 2023-07-16 01:13:29,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 01:13:29,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:29,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a31ad385ec1dde90564bfca7f4c25ca8, disabling compactions & flushes 2023-07-16 01:13:29,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:29,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:29,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. after waiting 0 ms 2023-07-16 01:13:29,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:29,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:29,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 374d93859dac3abb33b34fca929ac349, disabling compactions & flushes 2023-07-16 01:13:29,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:29,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:29,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. after waiting 0 ms 2023-07-16 01:13:29,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:29,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:29,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:29,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:29,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8. 2023-07-16 01:13:29,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:29,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a31ad385ec1dde90564bfca7f4c25ca8: 2023-07-16 01:13:29,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349. 2023-07-16 01:13:29,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 374d93859dac3abb33b34fca929ac349: 2023-07-16 01:13:29,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:29,117 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a31ad385ec1dde90564bfca7f4c25ca8, regionState=CLOSED 2023-07-16 01:13:29,117 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689470009117"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689470009117"}]},"ts":"1689470009117"} 2023-07-16 01:13:29,118 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=374d93859dac3abb33b34fca929ac349, regionState=CLOSED 2023-07-16 01:13:29,118 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689470009118"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689470009118"}]},"ts":"1689470009118"} 2023-07-16 01:13:29,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:29,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-16 01:13:29,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure a31ad385ec1dde90564bfca7f4c25ca8, server=jenkins-hbase4.apache.org,38989,1689469866617 in 192 msec 2023-07-16 01:13:29,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-16 01:13:29,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 374d93859dac3abb33b34fca929ac349, server=jenkins-hbase4.apache.org,41771,1689469866681 in 192 msec 2023-07-16 01:13:29,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a31ad385ec1dde90564bfca7f4c25ca8, UNASSIGN in 200 msec 2023-07-16 01:13:29,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-16 01:13:29,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=374d93859dac3abb33b34fca929ac349, UNASSIGN in 201 msec 2023-07-16 01:13:29,130 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689470009130"}]},"ts":"1689470009130"} 2023-07-16 01:13:29,132 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-16 01:13:29,133 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-16 01:13:29,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 226 msec 2023-07-16 01:13:29,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 01:13:29,221 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-16 01:13:29,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,226 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,226 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,228 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38989] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,232 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,232 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,232 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,232 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,232 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:29,232 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:29,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 01:13:29,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 01:13:29,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 01:13:29,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 01:13:29,235 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/recovered.edits] 2023-07-16 01:13:29,235 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/cf, FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/recovered.edits] 2023-07-16 01:13:29,237 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,237 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:29,237 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,237 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:29,237 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,238 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:29,237 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,238 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:29,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 01:13:29,244 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/cf/180f68099e024e60bc7a34f7e25d4424 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/cf/180f68099e024e60bc7a34f7e25d4424 2023-07-16 01:13:29,245 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/cf/a579d1a860a543a788c48bebf52094b8 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/cf/a579d1a860a543a788c48bebf52094b8 2023-07-16 01:13:29,250 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8/recovered.edits/9.seqid 2023-07-16 01:13:29,251 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/recovered.edits/9.seqid to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349/recovered.edits/9.seqid 2023-07-16 01:13:29,251 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a31ad385ec1dde90564bfca7f4c25ca8 2023-07-16 01:13:29,252 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/374d93859dac3abb33b34fca929ac349 2023-07-16 01:13:29,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 01:13:29,253 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-16 01:13:29,254 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-16 01:13:29,257 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716ec600e904017442cb5069effd6d27198 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716ec600e904017442cb5069effd6d27198 2023-07-16 01:13:29,259 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307169e25819530b640ff84cdd1671f5b5e14 to hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307169e25819530b640ff84cdd1671f5b5e14 2023-07-16 01:13:29,259 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-16 01:13:29,262 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,264 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-16 01:13:29,267 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-16 01:13:29,268 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,269 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-16 01:13:29,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689470009269"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:29,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689470009269"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:29,271 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:13:29,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a31ad385ec1dde90564bfca7f4c25ca8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689469988937.a31ad385ec1dde90564bfca7f4c25ca8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 374d93859dac3abb33b34fca929ac349, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469988937.374d93859dac3abb33b34fca929ac349.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:13:29,271 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-16 01:13:29,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689470009271"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:29,273 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-16 01:13:29,277 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 55 msec 2023-07-16 01:13:29,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 01:13:29,341 INFO [Listener at jenkins-hbase4.apache.org/32773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-16 01:13:29,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 01:13:29,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 01:13:29,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34911] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:29,385 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761 (was 761), OpenFileDescriptor=899 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=621 (was 532) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1217 (was 1717) 2023-07-16 01:13:29,385 WARN [Listener at jenkins-hbase4.apache.org/32773] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-16 01:13:29,385 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-16 01:13:29,400 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 01:13:29,521 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689469875797_0007_01_000001 is : 143 2023-07-16 01:13:34,685 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:13:43,532 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 01:13:57,649 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 01:13:57,650 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 01:13:57,764 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-16 01:13:57,774 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-16 01:13:57,776 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 01:13:57,788 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 01:13:57,892 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 01:13:57,892 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-16 01:13:57,892 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-16 01:13:57,892 INFO [Listener at jenkins-hbase4.apache.org/32773] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-16 01:13:57,893 DEBUG [Listener at jenkins-hbase4.apache.org/32773] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14cf5ca5 to 127.0.0.1:55425 2023-07-16 01:13:57,893 DEBUG [Listener at jenkins-hbase4.apache.org/32773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:57,893 DEBUG [Listener at jenkins-hbase4.apache.org/32773] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-16 01:13:57,893 DEBUG [Listener at jenkins-hbase4.apache.org/32773] util.JVMClusterUtil(257): Found active master hash=1192072436, stopped=false 2023-07-16 01:13:57,893 DEBUG [Listener at jenkins-hbase4.apache.org/32773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:57,893 DEBUG [Listener at jenkins-hbase4.apache.org/32773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 01:13:57,893 INFO [Listener at jenkins-hbase4.apache.org/32773] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:13:57,896 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 01:13:57,896 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 01:13:57,896 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:13:57,896 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 01:13:57,896 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 01:13:57,896 INFO [Listener at jenkins-hbase4.apache.org/32773] procedure2.ProcedureExecutor(629): Stopping 2023-07-16 01:13:57,896 DEBUG [Listener at jenkins-hbase4.apache.org/32773] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74d5c593 to 127.0.0.1:55425 2023-07-16 01:13:57,897 DEBUG [Listener at jenkins-hbase4.apache.org/32773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:57,897 INFO [Listener at jenkins-hbase4.apache.org/32773] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46827,1689469866564' ***** 2023-07-16 01:13:57,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:13:57,897 DEBUG [Listener at jenkins-hbase4.apache.org/32773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:57,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:13:57,897 INFO [Listener at jenkins-hbase4.apache.org/32773] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 01:13:57,897 INFO [Listener at jenkins-hbase4.apache.org/32773] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38989,1689469866617' ***** 2023-07-16 01:13:57,897 DEBUG [Listener at jenkins-hbase4.apache.org/32773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:57,898 INFO [Listener at jenkins-hbase4.apache.org/32773] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 01:13:57,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:13:57,898 INFO [Listener at jenkins-hbase4.apache.org/32773] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41771,1689469866681' ***** 2023-07-16 01:13:57,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:13:57,898 DEBUG [Listener at jenkins-hbase4.apache.org/32773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:57,898 INFO [RS:1;jenkins-hbase4:38989] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 01:13:57,898 INFO [Listener at jenkins-hbase4.apache.org/32773] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 01:13:57,898 INFO [RS:0;jenkins-hbase4:46827] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 01:13:57,898 INFO [RS:0;jenkins-hbase4:46827] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 01:13:57,898 INFO [RS:2;jenkins-hbase4:41771] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 01:13:57,898 INFO [RS:0;jenkins-hbase4:46827] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 01:13:57,898 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 01:13:57,898 INFO [RS:1;jenkins-hbase4:38989] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 01:13:57,898 INFO [RS:1;jenkins-hbase4:38989] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 01:13:57,899 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(3305): Received CLOSE for fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:13:57,899 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(3305): Received CLOSE for 8583216abc1d3c0b01a3ef4ff4308c8e 2023-07-16 01:13:57,899 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:57,899 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x020996c4 to 127.0.0.1:55425 2023-07-16 01:13:57,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fdeef80e2b3d835002e0e8cc9f27c92f, disabling compactions & flushes 2023-07-16 01:13:57,898 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:57,898 INFO [RS:2;jenkins-hbase4:41771] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 01:13:57,898 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 01:13:57,901 INFO [RS:2;jenkins-hbase4:41771] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 01:13:57,901 DEBUG [RS:0;jenkins-hbase4:46827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6baef2c0 to 127.0.0.1:55425 2023-07-16 01:13:57,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:13:57,900 DEBUG [RS:1;jenkins-hbase4:38989] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:57,898 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 01:13:57,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:13:57,902 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-16 01:13:57,901 DEBUG [RS:0;jenkins-hbase4:46827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:57,901 INFO [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:57,902 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1478): Online Regions={fdeef80e2b3d835002e0e8cc9f27c92f=hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f., 8583216abc1d3c0b01a3ef4ff4308c8e=hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e.} 2023-07-16 01:13:57,905 INFO [RS:0;jenkins-hbase4:46827] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 01:13:57,905 INFO [RS:0;jenkins-hbase4:46827] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 01:13:57,905 INFO [RS:0;jenkins-hbase4:46827] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 01:13:57,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. after waiting 0 ms 2023-07-16 01:13:57,905 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-16 01:13:57,905 DEBUG [RS:2;jenkins-hbase4:41771] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35112290 to 127.0.0.1:55425 2023-07-16 01:13:57,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:13:57,905 DEBUG [RS:2;jenkins-hbase4:41771] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:57,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fdeef80e2b3d835002e0e8cc9f27c92f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-16 01:13:57,906 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1504): Waiting on 8583216abc1d3c0b01a3ef4ff4308c8e, fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:13:57,906 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 01:13:57,907 INFO [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41771,1689469866681; all regions closed. 2023-07-16 01:13:57,907 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-16 01:13:57,908 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 01:13:57,908 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 01:13:57,908 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 01:13:57,908 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 01:13:57,908 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 01:13:57,908 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 01:13:57,908 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-16 01:13:57,934 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:57,941 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-16 01:13:57,941 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-16 01:13:57,975 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:57,975 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-16 01:13:57,976 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-16 01:13:57,981 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-16 01:13:57,981 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-16 01:13:57,984 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:57,999 DEBUG [RS:2;jenkins-hbase4:41771] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/oldWALs 2023-07-16 01:13:57,999 INFO [RS:2;jenkins-hbase4:41771] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41771%2C1689469866681:(num 1689469869126) 2023-07-16 01:13:57,999 DEBUG [RS:2;jenkins-hbase4:41771] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:57,999 INFO [RS:2;jenkins-hbase4:41771] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:58,036 INFO [RS:2;jenkins-hbase4:41771] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 01:13:58,036 INFO [RS:2;jenkins-hbase4:41771] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 01:13:58,036 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 01:13:58,036 INFO [RS:2;jenkins-hbase4:41771] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 01:13:58,037 INFO [RS:2;jenkins-hbase4:41771] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 01:13:58,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f/.tmp/l/8dee6a6b094c449fb69ab08284cef909 2023-07-16 01:13:58,047 INFO [RS:2;jenkins-hbase4:41771] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41771 2023-07-16 01:13:58,057 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:58,057 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:58,057 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:58,057 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:58,057 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:58,057 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41771,1689469866681 2023-07-16 01:13:58,057 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:58,058 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41771,1689469866681] 2023-07-16 01:13:58,059 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41771,1689469866681; numProcessing=1 2023-07-16 01:13:58,059 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/.tmp/info/52f8cf2e3fcc4bfeae81fe7029987dbd 2023-07-16 01:13:58,061 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41771,1689469866681 already deleted, retry=false 2023-07-16 01:13:58,061 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41771,1689469866681 expired; onlineServers=2 2023-07-16 01:13:58,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8dee6a6b094c449fb69ab08284cef909 2023-07-16 01:13:58,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f/.tmp/l/8dee6a6b094c449fb69ab08284cef909 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f/l/8dee6a6b094c449fb69ab08284cef909 2023-07-16 01:13:58,085 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52f8cf2e3fcc4bfeae81fe7029987dbd 2023-07-16 01:13:58,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8dee6a6b094c449fb69ab08284cef909 2023-07-16 01:13:58,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f/l/8dee6a6b094c449fb69ab08284cef909, entries=7, sequenceid=18, filesize=5.2 K 2023-07-16 01:13:58,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for fdeef80e2b3d835002e0e8cc9f27c92f in 186ms, sequenceid=18, compaction requested=false 2023-07-16 01:13:58,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/acl/fdeef80e2b3d835002e0e8cc9f27c92f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-16 01:13:58,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:58,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:13:58,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fdeef80e2b3d835002e0e8cc9f27c92f: 2023-07-16 01:13:58,106 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1504): Waiting on 8583216abc1d3c0b01a3ef4ff4308c8e, fdeef80e2b3d835002e0e8cc9f27c92f 2023-07-16 01:13:58,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689469870406.fdeef80e2b3d835002e0e8cc9f27c92f. 2023-07-16 01:13:58,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8583216abc1d3c0b01a3ef4ff4308c8e, disabling compactions & flushes 2023-07-16 01:13:58,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:13:58,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:13:58,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. after waiting 0 ms 2023-07-16 01:13:58,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:13:58,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8583216abc1d3c0b01a3ef4ff4308c8e 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-16 01:13:58,108 DEBUG [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 01:13:58,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/.tmp/rep_barrier/ffadc37d79bf49dca30154dd51781185 2023-07-16 01:13:58,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffadc37d79bf49dca30154dd51781185 2023-07-16 01:13:58,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e/.tmp/info/53881ccb4b7045b78838ac91181ab389 2023-07-16 01:13:58,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/.tmp/table/cd02af3fcf024e23b9df30eae5298bd3 2023-07-16 01:13:58,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e/.tmp/info/53881ccb4b7045b78838ac91181ab389 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e/info/53881ccb4b7045b78838ac91181ab389 2023-07-16 01:13:58,131 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd02af3fcf024e23b9df30eae5298bd3 2023-07-16 01:13:58,132 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/.tmp/info/52f8cf2e3fcc4bfeae81fe7029987dbd as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/info/52f8cf2e3fcc4bfeae81fe7029987dbd 2023-07-16 01:13:58,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e/info/53881ccb4b7045b78838ac91181ab389, entries=2, sequenceid=6, filesize=4.8 K 2023-07-16 01:13:58,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8583216abc1d3c0b01a3ef4ff4308c8e in 28ms, sequenceid=6, compaction requested=false 2023-07-16 01:13:58,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52f8cf2e3fcc4bfeae81fe7029987dbd 2023-07-16 01:13:58,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/info/52f8cf2e3fcc4bfeae81fe7029987dbd, entries=48, sequenceid=131, filesize=10.3 K 2023-07-16 01:13:58,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/.tmp/rep_barrier/ffadc37d79bf49dca30154dd51781185 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/rep_barrier/ffadc37d79bf49dca30154dd51781185 2023-07-16 01:13:58,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/namespace/8583216abc1d3c0b01a3ef4ff4308c8e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:58,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:58,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:13:58,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8583216abc1d3c0b01a3ef4ff4308c8e: 2023-07-16 01:13:58,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689469869632.8583216abc1d3c0b01a3ef4ff4308c8e. 2023-07-16 01:13:58,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffadc37d79bf49dca30154dd51781185 2023-07-16 01:13:58,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/rep_barrier/ffadc37d79bf49dca30154dd51781185, entries=13, sequenceid=131, filesize=6.4 K 2023-07-16 01:13:58,153 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/.tmp/table/cd02af3fcf024e23b9df30eae5298bd3 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/table/cd02af3fcf024e23b9df30eae5298bd3 2023-07-16 01:13:58,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd02af3fcf024e23b9df30eae5298bd3 2023-07-16 01:13:58,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/table/cd02af3fcf024e23b9df30eae5298bd3, entries=24, sequenceid=131, filesize=6.9 K 2023-07-16 01:13:58,159 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 251ms, sequenceid=131, compaction requested=false 2023-07-16 01:13:58,160 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:58,161 INFO [RS:2;jenkins-hbase4:41771] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41771,1689469866681; zookeeper connection closed. 2023-07-16 01:13:58,161 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:41771-0x1016baecab10003, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:58,163 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1e8ccbac] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1e8ccbac 2023-07-16 01:13:58,174 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-16 01:13:58,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:58,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 01:13:58,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 01:13:58,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 01:13:58,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-16 01:13:58,306 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38989,1689469866617; all regions closed. 2023-07-16 01:13:58,309 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46827,1689469866564; all regions closed. 2023-07-16 01:13:58,319 DEBUG [RS:1;jenkins-hbase4:38989] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/oldWALs 2023-07-16 01:13:58,319 INFO [RS:1;jenkins-hbase4:38989] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38989%2C1689469866617:(num 1689469869127) 2023-07-16 01:13:58,319 DEBUG [RS:1;jenkins-hbase4:38989] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:58,319 INFO [RS:1;jenkins-hbase4:38989] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:58,320 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 01:13:58,321 INFO [RS:1;jenkins-hbase4:38989] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 01:13:58,321 INFO [RS:1;jenkins-hbase4:38989] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 01:13:58,321 INFO [RS:1;jenkins-hbase4:38989] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 01:13:58,322 INFO [RS:1;jenkins-hbase4:38989] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38989 2023-07-16 01:13:58,323 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 01:13:58,325 DEBUG [RS:0;jenkins-hbase4:46827] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/oldWALs 2023-07-16 01:13:58,325 INFO [RS:0;jenkins-hbase4:46827] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46827%2C1689469866564.meta:.meta(num 1689469869273) 2023-07-16 01:13:58,327 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:58,328 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:58,328 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38989,1689469866617] 2023-07-16 01:13:58,328 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38989,1689469866617; numProcessing=2 2023-07-16 01:13:58,330 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38989,1689469866617 already deleted, retry=false 2023-07-16 01:13:58,330 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38989,1689469866617 expired; onlineServers=1 2023-07-16 01:13:58,335 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38989,1689469866617 2023-07-16 01:13:58,345 DEBUG [RS:0;jenkins-hbase4:46827] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/oldWALs 2023-07-16 01:13:58,345 INFO [RS:0;jenkins-hbase4:46827] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46827%2C1689469866564:(num 1689469869126) 2023-07-16 01:13:58,345 DEBUG [RS:0;jenkins-hbase4:46827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:58,345 INFO [RS:0;jenkins-hbase4:46827] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:58,345 INFO [RS:0;jenkins-hbase4:46827] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-16 01:13:58,345 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 01:13:58,346 INFO [RS:0;jenkins-hbase4:46827] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46827 2023-07-16 01:13:58,348 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:58,348 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46827,1689469866564 2023-07-16 01:13:58,350 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46827,1689469866564] 2023-07-16 01:13:58,350 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46827,1689469866564; numProcessing=3 2023-07-16 01:13:58,351 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46827,1689469866564 already deleted, retry=false 2023-07-16 01:13:58,351 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46827,1689469866564 expired; onlineServers=0 2023-07-16 01:13:58,351 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34911,1689469864893' ***** 2023-07-16 01:13:58,351 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-16 01:13:58,351 DEBUG [M:0;jenkins-hbase4:34911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6309ecf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 01:13:58,351 INFO [M:0;jenkins-hbase4:34911] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34911,1689469864893 2023-07-16 01:13:58,351 INFO [M:0;jenkins-hbase4:34911] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34911,1689469864893; all regions closed. 2023-07-16 01:13:58,351 DEBUG [M:0;jenkins-hbase4:34911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:58,351 DEBUG [M:0;jenkins-hbase4:34911] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-16 01:13:58,352 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-16 01:13:58,352 DEBUG [M:0;jenkins-hbase4:34911] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-16 01:13:58,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689469868559] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689469868559,5,FailOnTimeoutGroup] 2023-07-16 01:13:58,352 INFO [M:0;jenkins-hbase4:34911] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-16 01:13:58,352 INFO [M:0;jenkins-hbase4:34911] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-16 01:13:58,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689469868561] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689469868561,5,FailOnTimeoutGroup] 2023-07-16 01:13:58,352 INFO [M:0;jenkins-hbase4:34911] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-16 01:13:58,352 DEBUG [M:0;jenkins-hbase4:34911] master.HMaster(1512): Stopping service threads 2023-07-16 01:13:58,352 INFO [M:0;jenkins-hbase4:34911] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-16 01:13:58,353 ERROR [M:0;jenkins-hbase4:34911] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-16 01:13:58,353 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-16 01:13:58,353 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:13:58,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:13:58,353 INFO [M:0;jenkins-hbase4:34911] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-16 01:13:58,353 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-16 01:13:58,354 DEBUG [M:0;jenkins-hbase4:34911] zookeeper.ZKUtil(398): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-16 01:13:58,354 WARN [M:0;jenkins-hbase4:34911] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-16 01:13:58,354 INFO [M:0;jenkins-hbase4:34911] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-16 01:13:58,354 INFO [M:0;jenkins-hbase4:34911] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-16 01:13:58,354 DEBUG [M:0;jenkins-hbase4:34911] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 01:13:58,354 INFO [M:0;jenkins-hbase4:34911] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:13:58,354 DEBUG [M:0;jenkins-hbase4:34911] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:13:58,355 DEBUG [M:0;jenkins-hbase4:34911] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 01:13:58,355 DEBUG [M:0;jenkins-hbase4:34911] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:13:58,355 INFO [M:0;jenkins-hbase4:34911] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.89 KB 2023-07-16 01:13:58,380 INFO [M:0;jenkins-hbase4:34911] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/731ea4ef90924ed8a92071021abf3592 2023-07-16 01:13:58,385 INFO [M:0;jenkins-hbase4:34911] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 731ea4ef90924ed8a92071021abf3592 2023-07-16 01:13:58,386 DEBUG [M:0;jenkins-hbase4:34911] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/731ea4ef90924ed8a92071021abf3592 as hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/731ea4ef90924ed8a92071021abf3592 2023-07-16 01:13:58,392 INFO [M:0;jenkins-hbase4:34911] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 731ea4ef90924ed8a92071021abf3592 2023-07-16 01:13:58,392 INFO [M:0;jenkins-hbase4:34911] regionserver.HStore(1080): Added hdfs://localhost:35755/user/jenkins/test-data/2cf92306-b98c-d1ce-2902-008da92d7660/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/731ea4ef90924ed8a92071021abf3592, entries=119, sequenceid=899, filesize=28.6 K 2023-07-16 01:13:58,392 INFO [M:0;jenkins-hbase4:34911] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384670, heapSize ~451.88 KB/462720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 37ms, sequenceid=899, compaction requested=false 2023-07-16 01:13:58,394 INFO [M:0;jenkins-hbase4:34911] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:13:58,394 DEBUG [M:0;jenkins-hbase4:34911] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 01:13:58,398 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 01:13:58,398 INFO [M:0;jenkins-hbase4:34911] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-16 01:13:58,399 INFO [M:0;jenkins-hbase4:34911] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34911 2023-07-16 01:13:58,400 DEBUG [M:0;jenkins-hbase4:34911] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34911,1689469864893 already deleted, retry=false 2023-07-16 01:13:58,432 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:58,432 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38989,1689469866617; zookeeper connection closed. 2023-07-16 01:13:58,432 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x1016baecab10002, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:58,432 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3e2e8099] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3e2e8099 2023-07-16 01:13:58,532 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:58,532 INFO [M:0;jenkins-hbase4:34911] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34911,1689469864893; zookeeper connection closed. 2023-07-16 01:13:58,532 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): master:34911-0x1016baecab10000, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:58,632 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:58,632 INFO [RS:0;jenkins-hbase4:46827] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46827,1689469866564; zookeeper connection closed. 2023-07-16 01:13:58,632 DEBUG [Listener at localhost/36899-EventThread] zookeeper.ZKWatcher(600): regionserver:46827-0x1016baecab10001, quorum=127.0.0.1:55425, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:58,633 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7e713bf9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7e713bf9 2023-07-16 01:13:58,633 INFO [Listener at jenkins-hbase4.apache.org/32773] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-16 01:13:58,633 WARN [Listener at jenkins-hbase4.apache.org/32773] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 01:13:58,638 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 01:13:58,742 WARN [BP-1532919011-172.31.14.131-1689469860377 heartbeating to localhost/127.0.0.1:35755] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 01:13:58,742 WARN [BP-1532919011-172.31.14.131-1689469860377 heartbeating to localhost/127.0.0.1:35755] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1532919011-172.31.14.131-1689469860377 (Datanode Uuid a78ed80b-c2e2-4a74-8b56-fbb911e4f409) service to localhost/127.0.0.1:35755 2023-07-16 01:13:58,744 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data5/current/BP-1532919011-172.31.14.131-1689469860377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:58,745 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data6/current/BP-1532919011-172.31.14.131-1689469860377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:58,747 WARN [Listener at jenkins-hbase4.apache.org/32773] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 01:13:58,752 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 01:13:58,856 WARN [BP-1532919011-172.31.14.131-1689469860377 heartbeating to localhost/127.0.0.1:35755] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 01:13:58,856 WARN [BP-1532919011-172.31.14.131-1689469860377 heartbeating to localhost/127.0.0.1:35755] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1532919011-172.31.14.131-1689469860377 (Datanode Uuid 0f458073-5724-474a-bef3-37b5346c9bc5) service to localhost/127.0.0.1:35755 2023-07-16 01:13:58,856 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data3/current/BP-1532919011-172.31.14.131-1689469860377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:58,857 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data4/current/BP-1532919011-172.31.14.131-1689469860377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:58,858 WARN [Listener at jenkins-hbase4.apache.org/32773] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 01:13:58,861 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 01:13:58,965 WARN [BP-1532919011-172.31.14.131-1689469860377 heartbeating to localhost/127.0.0.1:35755] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 01:13:58,965 WARN [BP-1532919011-172.31.14.131-1689469860377 heartbeating to localhost/127.0.0.1:35755] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1532919011-172.31.14.131-1689469860377 (Datanode Uuid 2022eb44-02e1-411f-bb71-01c4942f55b6) service to localhost/127.0.0.1:35755 2023-07-16 01:13:58,966 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data1/current/BP-1532919011-172.31.14.131-1689469860377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:58,966 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/071803e0-308f-601a-b3fa-a8499a6ccb78/cluster_c840fd9c-1684-9465-47bb-f439024f8832/dfs/data/data2/current/BP-1532919011-172.31.14.131-1689469860377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:58,989 INFO [Listener at jenkins-hbase4.apache.org/32773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 01:13:59,132 INFO [Listener at jenkins-hbase4.apache.org/32773] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-16 01:13:59,276 INFO [Listener at jenkins-hbase4.apache.org/32773] hbase.HBaseTestingUtility(1293): Minicluster is down