2023-07-12 22:13:28,745 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 22:13:28,983 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a 2023-07-12 22:13:28,983 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-12 22:13:29,020 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 22:13:29,258 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 22:13:29,258 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268, deleteOnExit=true 2023-07-12 22:13:29,258 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 22:13:29,259 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/test.cache.data in system properties and HBase conf 2023-07-12 22:13:29,259 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 22:13:29,260 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop.log.dir in system properties and HBase conf 2023-07-12 22:13:29,260 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 22:13:29,260 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 22:13:29,261 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 22:13:29,590 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 22:13:29,596 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 22:13:29,596 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 22:13:29,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 22:13:29,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 22:13:29,598 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 22:13:29,598 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 22:13:29,598 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 22:13:29,599 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 22:13:29,599 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 22:13:29,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/nfs.dump.dir in system properties and HBase conf 2023-07-12 22:13:29,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir in system properties and HBase conf 2023-07-12 22:13:29,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 22:13:29,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 22:13:29,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 22:13:30,224 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 22:13:30,229 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 22:13:30,513 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 22:13:30,667 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 22:13:30,680 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:30,714 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:30,745 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir/Jetty_localhost_32963_hdfs____w6uqox/webapp 2023-07-12 22:13:30,879 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32963 2023-07-12 22:13:30,924 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 22:13:30,925 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 22:13:31,519 WARN [Listener at localhost/34859] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 22:13:31,622 WARN [Listener at localhost/34859] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 22:13:31,647 WARN [Listener at localhost/34859] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:31,654 INFO [Listener at localhost/34859] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:31,660 INFO [Listener at localhost/34859] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir/Jetty_localhost_32843_datanode____.gqf7s1/webapp 2023-07-12 22:13:31,788 INFO [Listener at localhost/34859] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32843 2023-07-12 22:13:32,270 WARN [Listener at localhost/45209] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 22:13:32,313 WARN [Listener at localhost/45209] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 22:13:32,319 WARN [Listener at localhost/45209] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:32,321 INFO [Listener at localhost/45209] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:32,329 INFO [Listener at localhost/45209] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir/Jetty_localhost_33339_datanode____.sj1ycg/webapp 2023-07-12 22:13:32,487 INFO [Listener at localhost/45209] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33339 2023-07-12 22:13:32,510 WARN [Listener at localhost/39499] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 22:13:32,563 WARN [Listener at localhost/39499] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 22:13:32,572 WARN [Listener at localhost/39499] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:32,575 INFO [Listener at localhost/39499] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:32,581 INFO [Listener at localhost/39499] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir/Jetty_localhost_46797_datanode____rsewxm/webapp 2023-07-12 22:13:32,751 INFO [Listener at localhost/39499] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46797 2023-07-12 22:13:32,775 WARN [Listener at localhost/36101] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 22:13:33,132 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6c439b9e3ec0be99: Processing first storage report for DS-b91483ff-12f0-4179-81de-d87c46fc41a8 from datanode 2bd28d4d-fe99-49ea-b922-3ec1a910880c 2023-07-12 22:13:33,134 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6c439b9e3ec0be99: from storage DS-b91483ff-12f0-4179-81de-d87c46fc41a8 node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=2bd28d4d-fe99-49ea-b922-3ec1a910880c, infoPort=45483, infoSecurePort=0, ipcPort=45209, storageInfo=lv=-57;cid=testClusterID;nsid=1268319365;c=1689200010297), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,134 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3800927a14c75948: Processing first storage report for DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d from datanode 922c7626-40d7-4581-bd8a-55f62ccbecd4 2023-07-12 22:13:33,134 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3800927a14c75948: from storage DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d node DatanodeRegistration(127.0.0.1:35617, datanodeUuid=922c7626-40d7-4581-bd8a-55f62ccbecd4, infoPort=33053, infoSecurePort=0, ipcPort=36101, storageInfo=lv=-57;cid=testClusterID;nsid=1268319365;c=1689200010297), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,135 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6c439b9e3ec0be99: Processing first storage report for DS-96fb67e0-f999-4e60-bc9d-92f0e44dccb7 from datanode 2bd28d4d-fe99-49ea-b922-3ec1a910880c 2023-07-12 22:13:33,136 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6c439b9e3ec0be99: from storage DS-96fb67e0-f999-4e60-bc9d-92f0e44dccb7 node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=2bd28d4d-fe99-49ea-b922-3ec1a910880c, infoPort=45483, infoSecurePort=0, ipcPort=45209, storageInfo=lv=-57;cid=testClusterID;nsid=1268319365;c=1689200010297), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,136 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd1113d1890ebd8c3: Processing first storage report for DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41 from datanode c3263a04-8e59-4900-bd26-8a4bb86024a6 2023-07-12 22:13:33,137 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd1113d1890ebd8c3: from storage DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41 node DatanodeRegistration(127.0.0.1:37043, datanodeUuid=c3263a04-8e59-4900-bd26-8a4bb86024a6, infoPort=44297, infoSecurePort=0, ipcPort=39499, storageInfo=lv=-57;cid=testClusterID;nsid=1268319365;c=1689200010297), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,137 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3800927a14c75948: Processing first storage report for DS-6a4fd7aa-fccf-4adf-8056-96141bd4332f from datanode 922c7626-40d7-4581-bd8a-55f62ccbecd4 2023-07-12 22:13:33,137 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3800927a14c75948: from storage DS-6a4fd7aa-fccf-4adf-8056-96141bd4332f node DatanodeRegistration(127.0.0.1:35617, datanodeUuid=922c7626-40d7-4581-bd8a-55f62ccbecd4, infoPort=33053, infoSecurePort=0, ipcPort=36101, storageInfo=lv=-57;cid=testClusterID;nsid=1268319365;c=1689200010297), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,137 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd1113d1890ebd8c3: Processing first storage report for DS-688fd460-cc4b-4009-8d43-3fe1fffbae9d from datanode c3263a04-8e59-4900-bd26-8a4bb86024a6 2023-07-12 22:13:33,137 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd1113d1890ebd8c3: from storage DS-688fd460-cc4b-4009-8d43-3fe1fffbae9d node DatanodeRegistration(127.0.0.1:37043, datanodeUuid=c3263a04-8e59-4900-bd26-8a4bb86024a6, infoPort=44297, infoSecurePort=0, ipcPort=39499, storageInfo=lv=-57;cid=testClusterID;nsid=1268319365;c=1689200010297), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 22:13:33,331 DEBUG [Listener at localhost/36101] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a 2023-07-12 22:13:33,402 INFO [Listener at localhost/36101] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/zookeeper_0, clientPort=50879, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 22:13:33,418 INFO [Listener at localhost/36101] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50879 2023-07-12 22:13:33,426 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:33,428 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:34,134 INFO [Listener at localhost/36101] util.FSUtils(471): Created version file at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 with version=8 2023-07-12 22:13:34,134 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/hbase-staging 2023-07-12 22:13:34,492 INFO [Listener at localhost/36101] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 22:13:35,152 INFO [Listener at localhost/36101] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 22:13:35,220 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,221 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,221 INFO [Listener at localhost/36101] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 22:13:35,221 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,222 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 22:13:35,423 INFO [Listener at localhost/36101] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 22:13:35,532 DEBUG [Listener at localhost/36101] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 22:13:35,633 INFO [Listener at localhost/36101] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38945 2023-07-12 22:13:35,647 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:35,648 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:35,671 INFO [Listener at localhost/36101] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38945 connecting to ZooKeeper ensemble=127.0.0.1:50879 2023-07-12 22:13:35,720 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:389450x0, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 22:13:35,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38945-0x1015b99334c0000 connected 2023-07-12 22:13:35,766 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:13:35,767 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:13:35,786 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 22:13:35,798 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38945 2023-07-12 22:13:35,798 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38945 2023-07-12 22:13:35,799 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38945 2023-07-12 22:13:35,802 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38945 2023-07-12 22:13:35,803 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38945 2023-07-12 22:13:35,812 INFO [Listener at localhost/36101] master.HMaster(444): hbase.rootdir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3, hbase.cluster.distributed=false 2023-07-12 22:13:35,894 INFO [Listener at localhost/36101] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 22:13:35,894 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,894 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,894 INFO [Listener at localhost/36101] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 22:13:35,895 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,895 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 22:13:35,900 INFO [Listener at localhost/36101] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 22:13:35,903 INFO [Listener at localhost/36101] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45649 2023-07-12 22:13:35,906 INFO [Listener at localhost/36101] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 22:13:35,914 DEBUG [Listener at localhost/36101] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 22:13:35,915 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:35,918 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:35,920 INFO [Listener at localhost/36101] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45649 connecting to ZooKeeper ensemble=127.0.0.1:50879 2023-07-12 22:13:35,926 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:456490x0, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 22:13:35,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45649-0x1015b99334c0001 connected 2023-07-12 22:13:35,927 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:13:35,929 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:13:35,930 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 22:13:35,931 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45649 2023-07-12 22:13:35,934 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45649 2023-07-12 22:13:35,935 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45649 2023-07-12 22:13:35,939 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45649 2023-07-12 22:13:35,940 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45649 2023-07-12 22:13:35,955 INFO [Listener at localhost/36101] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 22:13:35,955 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,955 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,956 INFO [Listener at localhost/36101] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 22:13:35,956 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:35,956 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 22:13:35,957 INFO [Listener at localhost/36101] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 22:13:35,958 INFO [Listener at localhost/36101] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34577 2023-07-12 22:13:35,959 INFO [Listener at localhost/36101] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 22:13:35,961 DEBUG [Listener at localhost/36101] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 22:13:35,962 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:35,971 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:35,975 INFO [Listener at localhost/36101] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34577 connecting to ZooKeeper ensemble=127.0.0.1:50879 2023-07-12 22:13:35,984 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:345770x0, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 22:13:35,985 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): regionserver:345770x0, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:13:35,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34577-0x1015b99334c0002 connected 2023-07-12 22:13:35,994 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:13:35,996 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 22:13:35,999 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34577 2023-07-12 22:13:35,999 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34577 2023-07-12 22:13:36,002 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34577 2023-07-12 22:13:36,006 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34577 2023-07-12 22:13:36,006 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34577 2023-07-12 22:13:36,024 INFO [Listener at localhost/36101] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 22:13:36,024 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,025 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,025 INFO [Listener at localhost/36101] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 22:13:36,025 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 22:13:36,025 INFO [Listener at localhost/36101] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 22:13:36,025 INFO [Listener at localhost/36101] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 22:13:36,027 INFO [Listener at localhost/36101] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34131 2023-07-12 22:13:36,028 INFO [Listener at localhost/36101] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 22:13:36,032 DEBUG [Listener at localhost/36101] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 22:13:36,034 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,036 INFO [Listener at localhost/36101] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,038 INFO [Listener at localhost/36101] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34131 connecting to ZooKeeper ensemble=127.0.0.1:50879 2023-07-12 22:13:36,047 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:341310x0, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 22:13:36,053 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): regionserver:341310x0, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:13:36,054 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): regionserver:341310x0, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:13:36,055 DEBUG [Listener at localhost/36101] zookeeper.ZKUtil(164): regionserver:341310x0, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 22:13:36,064 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34131 2023-07-12 22:13:36,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34131-0x1015b99334c0003 connected 2023-07-12 22:13:36,079 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34131 2023-07-12 22:13:36,080 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34131 2023-07-12 22:13:36,082 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34131 2023-07-12 22:13:36,085 DEBUG [Listener at localhost/36101] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34131 2023-07-12 22:13:36,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:13:36,101 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 22:13:36,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:13:36,129 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 22:13:36,129 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 22:13:36,129 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 22:13:36,129 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 22:13:36,129 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:36,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 22:13:36,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38945,1689200014307 from backup master directory 2023-07-12 22:13:36,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 22:13:36,137 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:13:36,138 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 22:13:36,138 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 22:13:36,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:13:36,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 22:13:36,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 22:13:36,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/hbase.id with ID: 30724ac3-bd5c-4731-88ca-cdf17202c065 2023-07-12 22:13:36,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 22:13:36,340 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:36,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5342c681 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:36,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56b8ea85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:36,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:13:36,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 22:13:36,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 22:13:36,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 22:13:36,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 22:13:36,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 22:13:36,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:36,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/data/master/store-tmp 2023-07-12 22:13:36,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:36,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 22:13:36,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:13:36,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:13:36,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 22:13:36,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:13:36,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:13:36,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 22:13:36,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/WALs/jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:13:36,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38945%2C1689200014307, suffix=, logDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/WALs/jenkins-hbase4.apache.org,38945,1689200014307, archiveDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/oldWALs, maxLogs=10 2023-07-12 22:13:36,725 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK] 2023-07-12 22:13:36,725 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK] 2023-07-12 22:13:36,726 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK] 2023-07-12 22:13:36,737 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 22:13:36,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/WALs/jenkins-hbase4.apache.org,38945,1689200014307/jenkins-hbase4.apache.org%2C38945%2C1689200014307.1689200016652 2023-07-12 22:13:36,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK], DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK]] 2023-07-12 22:13:36,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:13:36,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:36,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:36,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:36,912 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:36,920 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 22:13:36,957 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 22:13:36,971 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:36,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:36,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:37,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 22:13:37,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:37,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67338118, jitterRate=0.0034161508083343506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:37,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 22:13:37,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 22:13:37,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 22:13:37,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 22:13:37,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 22:13:37,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 7 msec 2023-07-12 22:13:37,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 48 msec 2023-07-12 22:13:37,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 22:13:37,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 22:13:37,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 22:13:37,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 22:13:37,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 22:13:37,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 22:13:37,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 22:13:37,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 22:13:37,231 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:37,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 22:13:37,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 22:13:37,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 22:13:37,256 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 22:13:37,256 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 22:13:37,256 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 22:13:37,256 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 22:13:37,256 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:37,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38945,1689200014307, sessionid=0x1015b99334c0000, setting cluster-up flag (Was=false) 2023-07-12 22:13:37,277 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:37,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 22:13:37,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:13:37,293 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:37,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 22:13:37,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:13:37,304 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp 2023-07-12 22:13:37,392 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(951): ClusterId : 30724ac3-bd5c-4731-88ca-cdf17202c065 2023-07-12 22:13:37,393 INFO [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(951): ClusterId : 30724ac3-bd5c-4731-88ca-cdf17202c065 2023-07-12 22:13:37,392 INFO [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(951): ClusterId : 30724ac3-bd5c-4731-88ca-cdf17202c065 2023-07-12 22:13:37,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 22:13:37,406 DEBUG [RS:0;jenkins-hbase4:45649] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 22:13:37,409 DEBUG [RS:1;jenkins-hbase4:34577] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 22:13:37,407 DEBUG [RS:2;jenkins-hbase4:34131] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 22:13:37,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:37,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 22:13:37,417 DEBUG [RS:0;jenkins-hbase4:45649] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 22:13:37,417 DEBUG [RS:0;jenkins-hbase4:45649] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 22:13:37,417 DEBUG [RS:2;jenkins-hbase4:34131] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 22:13:37,418 DEBUG [RS:2;jenkins-hbase4:34131] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 22:13:37,418 DEBUG [RS:1;jenkins-hbase4:34577] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 22:13:37,418 DEBUG [RS:1;jenkins-hbase4:34577] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 22:13:37,425 DEBUG [RS:1;jenkins-hbase4:34577] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 22:13:37,426 DEBUG [RS:0;jenkins-hbase4:45649] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 22:13:37,433 DEBUG [RS:2;jenkins-hbase4:34131] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 22:13:37,433 DEBUG [RS:1;jenkins-hbase4:34577] zookeeper.ReadOnlyZKClient(139): Connect 0x7045ebeb to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:37,439 DEBUG [RS:0;jenkins-hbase4:45649] zookeeper.ReadOnlyZKClient(139): Connect 0x103ad616 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:37,459 DEBUG [RS:2;jenkins-hbase4:34131] zookeeper.ReadOnlyZKClient(139): Connect 0x6819b9c6 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:37,495 DEBUG [RS:0;jenkins-hbase4:45649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5937c746, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:37,496 DEBUG [RS:1;jenkins-hbase4:34577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47d1e0a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:37,496 DEBUG [RS:0;jenkins-hbase4:45649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fd0e503, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 22:13:37,496 DEBUG [RS:1;jenkins-hbase4:34577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@89341a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 22:13:37,497 DEBUG [RS:2;jenkins-hbase4:34131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66de4ab5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:37,498 DEBUG [RS:2;jenkins-hbase4:34131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27e3408e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 22:13:37,525 DEBUG [RS:2;jenkins-hbase4:34131] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34131 2023-07-12 22:13:37,526 DEBUG [RS:1;jenkins-hbase4:34577] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34577 2023-07-12 22:13:37,533 INFO [RS:2;jenkins-hbase4:34131] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 22:13:37,534 INFO [RS:2;jenkins-hbase4:34131] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 22:13:37,534 DEBUG [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 22:13:37,535 INFO [RS:2;jenkins-hbase4:34131] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:37,536 DEBUG [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 22:13:37,535 INFO [RS:1;jenkins-hbase4:34577] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 22:13:37,536 INFO [RS:1;jenkins-hbase4:34577] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 22:13:37,536 DEBUG [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 22:13:37,536 INFO [RS:1;jenkins-hbase4:34577] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:37,537 DEBUG [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 22:13:37,540 INFO [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38945,1689200014307 with isa=jenkins-hbase4.apache.org/172.31.14.131:34131, startcode=1689200016023 2023-07-12 22:13:37,542 INFO [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38945,1689200014307 with isa=jenkins-hbase4.apache.org/172.31.14.131:34577, startcode=1689200015954 2023-07-12 22:13:37,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 22:13:37,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 22:13:37,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 22:13:37,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 22:13:37,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 22:13:37,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-12 22:13:37,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 22:13:37,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,559 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45649 2023-07-12 22:13:37,559 INFO [RS:0;jenkins-hbase4:45649] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 22:13:37,559 INFO [RS:0;jenkins-hbase4:45649] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 22:13:37,559 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 22:13:37,559 INFO [RS:0;jenkins-hbase4:45649] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:37,559 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 22:13:37,560 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38945,1689200014307 with isa=jenkins-hbase4.apache.org/172.31.14.131:45649, startcode=1689200015893 2023-07-12 22:13:37,565 DEBUG [RS:1;jenkins-hbase4:34577] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 22:13:37,570 DEBUG [RS:0;jenkins-hbase4:45649] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 22:13:37,571 DEBUG [RS:2;jenkins-hbase4:34131] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 22:13:37,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689200047640 2023-07-12 22:13:37,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 22:13:37,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 22:13:37,665 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 22:13:37,666 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 22:13:37,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 22:13:37,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 22:13:37,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 22:13:37,673 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 22:13:37,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 22:13:37,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 22:13:37,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 22:13:37,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 22:13:37,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 22:13:37,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 22:13:37,694 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38259, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 22:13:37,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689200017695,5,FailOnTimeoutGroup] 2023-07-12 22:13:37,696 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55003, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 22:13:37,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689200017699,5,FailOnTimeoutGroup] 2023-07-12 22:13:37,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 22:13:37,694 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51889, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 22:13:37,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,716 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38945] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:37,749 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38945] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:37,750 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38945] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:37,756 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:13:37,758 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34859 2023-07-12 22:13:37,758 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 22:13:37,760 DEBUG [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:13:37,760 DEBUG [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34859 2023-07-12 22:13:37,760 DEBUG [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 22:13:37,761 DEBUG [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:13:37,761 DEBUG [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34859 2023-07-12 22:13:37,761 DEBUG [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 22:13:37,777 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:37,778 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:37,779 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:13:37,779 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:13:37,784 DEBUG [RS:2;jenkins-hbase4:34131] zookeeper.ZKUtil(162): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:37,784 WARN [RS:2;jenkins-hbase4:34131] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 22:13:37,784 INFO [RS:2;jenkins-hbase4:34131] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:37,785 DEBUG [RS:0;jenkins-hbase4:45649] zookeeper.ZKUtil(162): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:37,785 DEBUG [RS:1;jenkins-hbase4:34577] zookeeper.ZKUtil(162): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:37,786 WARN [RS:1;jenkins-hbase4:34577] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 22:13:37,786 INFO [RS:1;jenkins-hbase4:34577] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:37,786 WARN [RS:0;jenkins-hbase4:45649] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 22:13:37,786 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34577,1689200015954] 2023-07-12 22:13:37,786 DEBUG [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:37,788 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34131,1689200016023] 2023-07-12 22:13:37,788 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45649,1689200015893] 2023-07-12 22:13:37,788 INFO [RS:0;jenkins-hbase4:45649] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:37,788 DEBUG [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:37,789 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:37,814 DEBUG [RS:2;jenkins-hbase4:34131] zookeeper.ZKUtil(162): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:37,814 DEBUG [RS:1;jenkins-hbase4:34577] zookeeper.ZKUtil(162): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:37,815 DEBUG [RS:1;jenkins-hbase4:34577] zookeeper.ZKUtil(162): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:37,815 DEBUG [RS:2;jenkins-hbase4:34131] zookeeper.ZKUtil(162): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:37,816 DEBUG [RS:1;jenkins-hbase4:34577] zookeeper.ZKUtil(162): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:37,816 DEBUG [RS:0;jenkins-hbase4:45649] zookeeper.ZKUtil(162): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:37,816 DEBUG [RS:2;jenkins-hbase4:34131] zookeeper.ZKUtil(162): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:37,817 DEBUG [RS:0;jenkins-hbase4:45649] zookeeper.ZKUtil(162): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:37,817 DEBUG [RS:0;jenkins-hbase4:45649] zookeeper.ZKUtil(162): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:37,832 DEBUG [RS:1;jenkins-hbase4:34577] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 22:13:37,832 DEBUG [RS:2;jenkins-hbase4:34131] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 22:13:37,832 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 22:13:37,853 INFO [RS:2;jenkins-hbase4:34131] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 22:13:37,854 INFO [RS:0;jenkins-hbase4:45649] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 22:13:37,854 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:37,854 INFO [RS:1;jenkins-hbase4:34577] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 22:13:37,858 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 22:13:37,861 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/info 2023-07-12 22:13:37,862 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 22:13:37,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:37,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 22:13:37,868 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/rep_barrier 2023-07-12 22:13:37,869 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 22:13:37,871 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:37,871 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 22:13:37,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/table 2023-07-12 22:13:37,878 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 22:13:37,881 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:37,883 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740 2023-07-12 22:13:37,900 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740 2023-07-12 22:13:37,905 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 22:13:37,912 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 22:13:37,913 INFO [RS:2;jenkins-hbase4:34131] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 22:13:37,913 INFO [RS:0;jenkins-hbase4:45649] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 22:13:37,918 INFO [RS:1;jenkins-hbase4:34577] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 22:13:37,922 INFO [RS:2;jenkins-hbase4:34131] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 22:13:37,922 INFO [RS:2;jenkins-hbase4:34131] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,923 INFO [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 22:13:37,922 INFO [RS:0;jenkins-hbase4:45649] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 22:13:37,929 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:37,922 INFO [RS:1;jenkins-hbase4:34577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 22:13:37,930 INFO [RS:1;jenkins-hbase4:34577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,929 INFO [RS:0;jenkins-hbase4:45649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,931 INFO [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 22:13:37,931 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66665120, jitterRate=-0.006612300872802734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 22:13:37,932 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 22:13:37,932 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 22:13:37,932 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 22:13:37,932 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 22:13:37,932 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 22:13:37,932 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 22:13:37,935 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 22:13:37,939 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 22:13:37,939 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 22:13:37,941 INFO [RS:2;jenkins-hbase4:34131] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,941 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,941 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,942 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,942 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,942 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,941 INFO [RS:1;jenkins-hbase4:34577] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,941 INFO [RS:0;jenkins-hbase4:45649] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,943 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,943 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,943 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,944 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,944 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,944 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 22:13:37,944 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,944 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,944 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,944 DEBUG [RS:0;jenkins-hbase4:45649] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,942 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,942 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 22:13:37,944 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:2;jenkins-hbase4:34131] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 22:13:37,945 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,945 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,946 DEBUG [RS:1;jenkins-hbase4:34577] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 22:13:37,948 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 22:13:37,948 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 22:13:37,954 INFO [RS:0;jenkins-hbase4:45649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,955 INFO [RS:0;jenkins-hbase4:45649] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,955 INFO [RS:0;jenkins-hbase4:45649] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 22:13:37,966 INFO [RS:2;jenkins-hbase4:34131] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,967 INFO [RS:2;jenkins-hbase4:34131] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,967 INFO [RS:2;jenkins-hbase4:34131] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,968 INFO [RS:1;jenkins-hbase4:34577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,968 INFO [RS:1;jenkins-hbase4:34577] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,968 INFO [RS:1;jenkins-hbase4:34577] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,988 INFO [RS:1;jenkins-hbase4:34577] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 22:13:37,992 INFO [RS:1;jenkins-hbase4:34577] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34577,1689200015954-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:37,994 INFO [RS:2;jenkins-hbase4:34131] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 22:13:37,995 INFO [RS:2;jenkins-hbase4:34131] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34131,1689200016023-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,006 INFO [RS:0;jenkins-hbase4:45649] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 22:13:38,009 INFO [RS:0;jenkins-hbase4:45649] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45649,1689200015893-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,031 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 22:13:38,035 INFO [RS:1;jenkins-hbase4:34577] regionserver.Replication(203): jenkins-hbase4.apache.org,34577,1689200015954 started 2023-07-12 22:13:38,035 INFO [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34577,1689200015954, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34577, sessionid=0x1015b99334c0002 2023-07-12 22:13:38,036 DEBUG [RS:1;jenkins-hbase4:34577] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 22:13:38,036 DEBUG [RS:1;jenkins-hbase4:34577] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:38,036 DEBUG [RS:1;jenkins-hbase4:34577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34577,1689200015954' 2023-07-12 22:13:38,036 DEBUG [RS:1;jenkins-hbase4:34577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 22:13:38,037 DEBUG [RS:1;jenkins-hbase4:34577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 22:13:38,043 DEBUG [RS:1;jenkins-hbase4:34577] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 22:13:38,043 DEBUG [RS:1;jenkins-hbase4:34577] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 22:13:38,043 DEBUG [RS:1;jenkins-hbase4:34577] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:38,043 DEBUG [RS:1;jenkins-hbase4:34577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34577,1689200015954' 2023-07-12 22:13:38,043 DEBUG [RS:1;jenkins-hbase4:34577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:38,044 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 22:13:38,044 DEBUG [RS:1;jenkins-hbase4:34577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:38,045 DEBUG [RS:1;jenkins-hbase4:34577] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 22:13:38,045 INFO [RS:1;jenkins-hbase4:34577] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 22:13:38,045 INFO [RS:1;jenkins-hbase4:34577] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 22:13:38,054 INFO [RS:2;jenkins-hbase4:34131] regionserver.Replication(203): jenkins-hbase4.apache.org,34131,1689200016023 started 2023-07-12 22:13:38,054 INFO [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34131,1689200016023, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34131, sessionid=0x1015b99334c0003 2023-07-12 22:13:38,054 DEBUG [RS:2;jenkins-hbase4:34131] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 22:13:38,054 DEBUG [RS:2;jenkins-hbase4:34131] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:38,055 DEBUG [RS:2;jenkins-hbase4:34131] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34131,1689200016023' 2023-07-12 22:13:38,056 DEBUG [RS:2;jenkins-hbase4:34131] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 22:13:38,063 DEBUG [RS:2;jenkins-hbase4:34131] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 22:13:38,065 DEBUG [RS:2;jenkins-hbase4:34131] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 22:13:38,065 DEBUG [RS:2;jenkins-hbase4:34131] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 22:13:38,065 DEBUG [RS:2;jenkins-hbase4:34131] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:38,066 DEBUG [RS:2;jenkins-hbase4:34131] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34131,1689200016023' 2023-07-12 22:13:38,066 DEBUG [RS:2;jenkins-hbase4:34131] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:38,066 DEBUG [RS:2;jenkins-hbase4:34131] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:38,067 DEBUG [RS:2;jenkins-hbase4:34131] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 22:13:38,073 INFO [RS:0;jenkins-hbase4:45649] regionserver.Replication(203): jenkins-hbase4.apache.org,45649,1689200015893 started 2023-07-12 22:13:38,067 INFO [RS:2;jenkins-hbase4:34131] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 22:13:38,073 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45649,1689200015893, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45649, sessionid=0x1015b99334c0001 2023-07-12 22:13:38,073 INFO [RS:2;jenkins-hbase4:34131] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 22:13:38,074 DEBUG [RS:0;jenkins-hbase4:45649] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 22:13:38,074 DEBUG [RS:0;jenkins-hbase4:45649] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:38,074 DEBUG [RS:0;jenkins-hbase4:45649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45649,1689200015893' 2023-07-12 22:13:38,074 DEBUG [RS:0;jenkins-hbase4:45649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 22:13:38,074 DEBUG [RS:0;jenkins-hbase4:45649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 22:13:38,075 DEBUG [RS:0;jenkins-hbase4:45649] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 22:13:38,075 DEBUG [RS:0;jenkins-hbase4:45649] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 22:13:38,075 DEBUG [RS:0;jenkins-hbase4:45649] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:38,075 DEBUG [RS:0;jenkins-hbase4:45649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45649,1689200015893' 2023-07-12 22:13:38,075 DEBUG [RS:0;jenkins-hbase4:45649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:38,076 DEBUG [RS:0;jenkins-hbase4:45649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:38,076 DEBUG [RS:0;jenkins-hbase4:45649] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 22:13:38,077 INFO [RS:0;jenkins-hbase4:45649] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 22:13:38,077 INFO [RS:0;jenkins-hbase4:45649] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 22:13:38,164 INFO [RS:1;jenkins-hbase4:34577] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34577%2C1689200015954, suffix=, logDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,34577,1689200015954, archiveDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/oldWALs, maxLogs=32 2023-07-12 22:13:38,177 INFO [RS:2;jenkins-hbase4:34131] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34131%2C1689200016023, suffix=, logDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,34131,1689200016023, archiveDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/oldWALs, maxLogs=32 2023-07-12 22:13:38,181 INFO [RS:0;jenkins-hbase4:45649] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45649%2C1689200015893, suffix=, logDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,45649,1689200015893, archiveDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/oldWALs, maxLogs=32 2023-07-12 22:13:38,198 DEBUG [jenkins-hbase4:38945] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 22:13:38,207 DEBUG [jenkins-hbase4:38945] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:13:38,221 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK] 2023-07-12 22:13:38,232 DEBUG [jenkins-hbase4:38945] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:13:38,232 DEBUG [jenkins-hbase4:38945] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:13:38,232 DEBUG [jenkins-hbase4:38945] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:13:38,232 DEBUG [jenkins-hbase4:38945] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:13:38,246 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45649,1689200015893, state=OPENING 2023-07-12 22:13:38,247 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK] 2023-07-12 22:13:38,248 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK] 2023-07-12 22:13:38,248 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK] 2023-07-12 22:13:38,255 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK] 2023-07-12 22:13:38,256 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK] 2023-07-12 22:13:38,256 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK] 2023-07-12 22:13:38,256 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK] 2023-07-12 22:13:38,256 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK] 2023-07-12 22:13:38,257 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 22:13:38,275 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:38,288 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 22:13:38,289 INFO [RS:1;jenkins-hbase4:34577] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,34577,1689200015954/jenkins-hbase4.apache.org%2C34577%2C1689200015954.1689200018171 2023-07-12 22:13:38,289 INFO [RS:2;jenkins-hbase4:34131] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,34131,1689200016023/jenkins-hbase4.apache.org%2C34131%2C1689200016023.1689200018180 2023-07-12 22:13:38,290 INFO [RS:0;jenkins-hbase4:45649] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,45649,1689200015893/jenkins-hbase4.apache.org%2C45649%2C1689200015893.1689200018183 2023-07-12 22:13:38,290 DEBUG [RS:1;jenkins-hbase4:34577] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK], DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK]] 2023-07-12 22:13:38,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:13:38,296 DEBUG [RS:2;jenkins-hbase4:34131] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK], DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK], DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK]] 2023-07-12 22:13:38,296 DEBUG [RS:0;jenkins-hbase4:45649] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK], DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK]] 2023-07-12 22:13:38,483 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:38,486 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:13:38,491 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:13:38,514 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 22:13:38,514 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 22:13:38,518 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45649%2C1689200015893.meta, suffix=.meta, logDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,45649,1689200015893, archiveDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/oldWALs, maxLogs=32 2023-07-12 22:13:38,540 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK] 2023-07-12 22:13:38,540 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK] 2023-07-12 22:13:38,541 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK] 2023-07-12 22:13:38,556 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/WALs/jenkins-hbase4.apache.org,45649,1689200015893/jenkins-hbase4.apache.org%2C45649%2C1689200015893.meta.1689200018519.meta 2023-07-12 22:13:38,558 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35617,DS-6a8dc3a9-c166-41c4-b46d-dd0e0587b45d,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-b91483ff-12f0-4179-81de-d87c46fc41a8,DISK], DatanodeInfoWithStorage[127.0.0.1:37043,DS-2b6704b3-2c80-49ba-acbc-23adbcc57d41,DISK]] 2023-07-12 22:13:38,558 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:13:38,559 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 22:13:38,560 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:38,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 22:13:38,563 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 22:13:38,565 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 22:13:38,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 22:13:38,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:38,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 22:13:38,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 22:13:38,581 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 22:13:38,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/info 2023-07-12 22:13:38,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/info 2023-07-12 22:13:38,585 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 22:13:38,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:38,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 22:13:38,588 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/rep_barrier 2023-07-12 22:13:38,588 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/rep_barrier 2023-07-12 22:13:38,589 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 22:13:38,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:38,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 22:13:38,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/table 2023-07-12 22:13:38,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/table 2023-07-12 22:13:38,592 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 22:13:38,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:38,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740 2023-07-12 22:13:38,599 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740 2023-07-12 22:13:38,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 22:13:38,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 22:13:38,608 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72971283, jitterRate=0.08735685050487518}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 22:13:38,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 22:13:38,620 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689200018475 2023-07-12 22:13:38,644 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 22:13:38,645 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 22:13:38,645 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45649,1689200015893, state=OPEN 2023-07-12 22:13:38,649 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 22:13:38,649 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 22:13:38,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 22:13:38,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45649,1689200015893 in 355 msec 2023-07-12 22:13:38,660 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 22:13:38,660 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 693 msec 2023-07-12 22:13:38,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2430 sec 2023-07-12 22:13:38,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689200018668, completionTime=-1 2023-07-12 22:13:38,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 22:13:38,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 22:13:38,755 DEBUG [hconnection-0x36d5a956-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:38,760 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:38,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 22:13:38,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689200078787 2023-07-12 22:13:38,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689200138788 2023-07-12 22:13:38,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 118 msec 2023-07-12 22:13:38,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38945,1689200014307-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38945,1689200014307-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38945,1689200014307-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38945, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 22:13:38,830 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 22:13:38,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 22:13:38,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 22:13:38,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 22:13:38,868 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:13:38,877 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:13:38,906 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129 2023-07-12 22:13:38,909 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129 empty. 2023-07-12 22:13:38,911 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129 2023-07-12 22:13:38,911 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 22:13:38,963 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:38,966 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4b6145bffafa75395ae062c8e457129, NAME => 'hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:13:38,989 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:38,989 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e4b6145bffafa75395ae062c8e457129, disabling compactions & flushes 2023-07-12 22:13:38,989 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:13:38,989 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:13:38,989 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. after waiting 0 ms 2023-07-12 22:13:38,989 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:13:38,989 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:13:38,989 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e4b6145bffafa75395ae062c8e457129: 2023-07-12 22:13:38,994 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:13:39,010 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689200018997"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200018997"}]},"ts":"1689200018997"} 2023-07-12 22:13:39,042 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 22:13:39,044 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:13:39,050 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200019045"}]},"ts":"1689200019045"} 2023-07-12 22:13:39,056 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 22:13:39,063 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:13:39,064 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:13:39,064 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:13:39,064 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:13:39,065 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:13:39,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e4b6145bffafa75395ae062c8e457129, ASSIGN}] 2023-07-12 22:13:39,070 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e4b6145bffafa75395ae062c8e457129, ASSIGN 2023-07-12 22:13:39,072 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e4b6145bffafa75395ae062c8e457129, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45649,1689200015893; forceNewPlan=false, retain=false 2023-07-12 22:13:39,224 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 22:13:39,225 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e4b6145bffafa75395ae062c8e457129, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:39,226 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689200019225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200019225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200019225"}]},"ts":"1689200019225"} 2023-07-12 22:13:39,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e4b6145bffafa75395ae062c8e457129, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:13:39,394 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:13:39,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4b6145bffafa75395ae062c8e457129, NAME => 'hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129.', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:13:39,395 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. service=AccessControlService 2023-07-12 22:13:39,396 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:39,396 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e4b6145bffafa75395ae062c8e457129 2023-07-12 22:13:39,396 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:39,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4b6145bffafa75395ae062c8e457129 2023-07-12 22:13:39,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4b6145bffafa75395ae062c8e457129 2023-07-12 22:13:39,401 INFO [StoreOpener-e4b6145bffafa75395ae062c8e457129-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e4b6145bffafa75395ae062c8e457129 2023-07-12 22:13:39,405 DEBUG [StoreOpener-e4b6145bffafa75395ae062c8e457129-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129/info 2023-07-12 22:13:39,405 DEBUG [StoreOpener-e4b6145bffafa75395ae062c8e457129-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129/info 2023-07-12 22:13:39,405 INFO [StoreOpener-e4b6145bffafa75395ae062c8e457129-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4b6145bffafa75395ae062c8e457129 columnFamilyName info 2023-07-12 22:13:39,406 INFO [StoreOpener-e4b6145bffafa75395ae062c8e457129-1] regionserver.HStore(310): Store=e4b6145bffafa75395ae062c8e457129/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:39,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129 2023-07-12 22:13:39,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129 2023-07-12 22:13:39,416 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4b6145bffafa75395ae062c8e457129 2023-07-12 22:13:39,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:39,420 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4b6145bffafa75395ae062c8e457129; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64216085, jitterRate=-0.04310576617717743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:39,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4b6145bffafa75395ae062c8e457129: 2023-07-12 22:13:39,422 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129., pid=6, masterSystemTime=1689200019387 2023-07-12 22:13:39,425 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:13:39,425 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:13:39,427 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e4b6145bffafa75395ae062c8e457129, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:39,427 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689200019426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200019426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200019426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200019426"}]},"ts":"1689200019426"} 2023-07-12 22:13:39,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 22:13:39,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e4b6145bffafa75395ae062c8e457129, server=jenkins-hbase4.apache.org,45649,1689200015893 in 198 msec 2023-07-12 22:13:39,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 22:13:39,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e4b6145bffafa75395ae062c8e457129, ASSIGN in 367 msec 2023-07-12 22:13:39,441 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:13:39,441 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200019441"}]},"ts":"1689200019441"} 2023-07-12 22:13:39,444 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 22:13:39,447 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:13:39,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 600 msec 2023-07-12 22:13:39,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 22:13:39,466 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 22:13:39,466 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:39,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 22:13:39,512 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 22:13:39,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 26 msec 2023-07-12 22:13:39,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 22:13:39,533 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 22:13:39,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-12 22:13:39,547 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 22:13:39,550 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 22:13:39,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.413sec 2023-07-12 22:13:39,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 22:13:39,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 22:13:39,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 22:13:39,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38945,1689200014307-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 22:13:39,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38945,1689200014307-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 22:13:39,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 22:13:39,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 22:13:39,585 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:13:39,587 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:13:39,590 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:13:39,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 22:13:39,591 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5 empty. 2023-07-12 22:13:39,593 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:13:39,593 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 22:13:39,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 22:13:39,603 DEBUG [Listener at localhost/36101] zookeeper.ReadOnlyZKClient(139): Connect 0x49f3c037 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:39,614 DEBUG [Listener at localhost/36101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34d8312b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:39,654 DEBUG [hconnection-0x2e7d2e67-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:39,655 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:39,658 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => cedb9763ff93422ea823516ccf9edef5, NAME => 'hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:13:39,671 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:39,677 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:13:39,678 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 22:13:39,678 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/test.cache.data in system properties and HBase conf 2023-07-12 22:13:39,678 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 22:13:39,678 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop.log.dir in system properties and HBase conf 2023-07-12 22:13:39,679 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 22:13:39,679 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 22:13:39,679 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 22:13:39,679 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 22:13:39,679 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 22:13:39,679 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 22:13:39,679 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 22:13:39,680 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 22:13:39,680 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 22:13:39,680 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 22:13:39,680 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 22:13:39,680 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 22:13:39,681 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/nfs.dump.dir in system properties and HBase conf 2023-07-12 22:13:39,681 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir in system properties and HBase conf 2023-07-12 22:13:39,681 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 22:13:39,681 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 22:13:39,682 INFO [Listener at localhost/36101] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 22:13:39,684 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:39,684 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing cedb9763ff93422ea823516ccf9edef5, disabling compactions & flushes 2023-07-12 22:13:39,684 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:13:39,684 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:13:39,684 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. after waiting 0 ms 2023-07-12 22:13:39,684 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:13:39,684 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:13:39,684 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for cedb9763ff93422ea823516ccf9edef5: 2023-07-12 22:13:39,688 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:13:39,690 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689200019689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200019689"}]},"ts":"1689200019689"} 2023-07-12 22:13:39,692 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 22:13:39,694 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:13:39,694 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200019694"}]},"ts":"1689200019694"} 2023-07-12 22:13:39,696 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 22:13:39,701 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:13:39,702 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:13:39,702 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:13:39,702 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:13:39,702 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:13:39,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=cedb9763ff93422ea823516ccf9edef5, ASSIGN}] 2023-07-12 22:13:39,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 22:13:39,704 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=cedb9763ff93422ea823516ccf9edef5, ASSIGN 2023-07-12 22:13:39,706 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=cedb9763ff93422ea823516ccf9edef5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45649,1689200015893; forceNewPlan=false, retain=false 2023-07-12 22:13:39,856 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 22:13:39,857 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cedb9763ff93422ea823516ccf9edef5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:39,857 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689200019857"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200019857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200019857"}]},"ts":"1689200019857"} 2023-07-12 22:13:39,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure cedb9763ff93422ea823516ccf9edef5, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:13:39,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 22:13:40,026 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:13:40,026 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cedb9763ff93422ea823516ccf9edef5, NAME => 'hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5.', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:13:40,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. service=AccessControlService 2023-07-12 22:13:40,027 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:40,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:13:40,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:40,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:13:40,028 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:13:40,030 INFO [StoreOpener-cedb9763ff93422ea823516ccf9edef5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:13:40,032 DEBUG [StoreOpener-cedb9763ff93422ea823516ccf9edef5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5/l 2023-07-12 22:13:40,032 DEBUG [StoreOpener-cedb9763ff93422ea823516ccf9edef5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5/l 2023-07-12 22:13:40,033 INFO [StoreOpener-cedb9763ff93422ea823516ccf9edef5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cedb9763ff93422ea823516ccf9edef5 columnFamilyName l 2023-07-12 22:13:40,034 INFO [StoreOpener-cedb9763ff93422ea823516ccf9edef5-1] regionserver.HStore(310): Store=cedb9763ff93422ea823516ccf9edef5/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:40,036 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:13:40,038 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:13:40,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:13:40,050 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:40,051 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cedb9763ff93422ea823516ccf9edef5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73827936, jitterRate=0.10012197494506836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:40,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cedb9763ff93422ea823516ccf9edef5: 2023-07-12 22:13:40,053 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5., pid=11, masterSystemTime=1689200020021 2023-07-12 22:13:40,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:13:40,056 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:13:40,057 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cedb9763ff93422ea823516ccf9edef5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:40,057 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689200020057"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200020057"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200020057"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200020057"}]},"ts":"1689200020057"} 2023-07-12 22:13:40,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 22:13:40,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure cedb9763ff93422ea823516ccf9edef5, server=jenkins-hbase4.apache.org,45649,1689200015893 in 199 msec 2023-07-12 22:13:40,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 22:13:40,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=cedb9763ff93422ea823516ccf9edef5, ASSIGN in 364 msec 2023-07-12 22:13:40,079 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:13:40,079 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200020079"}]},"ts":"1689200020079"} 2023-07-12 22:13:40,083 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 22:13:40,088 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:13:40,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 507 msec 2023-07-12 22:13:40,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 22:13:40,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 22:13:40,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 22:13:40,987 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:41,307 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:41,313 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37699_jobhistory____ljiemz/webapp 2023-07-12 22:13:41,473 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 22:13:41,473 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 22:13:41,473 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 22:13:41,476 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 22:13:41,547 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:41,841 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:42,129 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 22:13:42,179 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37699 2023-07-12 22:13:42,486 WARN [Listener at jenkins-hbase4.apache.org/46199] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:42,643 WARN [Listener at jenkins-hbase4.apache.org/46199] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 22:13:42,644 INFO [Listener at jenkins-hbase4.apache.org/46199] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:42,656 INFO [Listener at jenkins-hbase4.apache.org/46199] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33375_cluster____1ph637/webapp 2023-07-12 22:13:42,822 INFO [Listener at jenkins-hbase4.apache.org/46199] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 22:13:42,823 INFO [Listener at jenkins-hbase4.apache.org/46199] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 22:13:42,823 INFO [Listener at jenkins-hbase4.apache.org/46199] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 22:13:42,823 INFO [Listener at jenkins-hbase4.apache.org/46199] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 22:13:42,834 INFO [Listener at jenkins-hbase4.apache.org/46199] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:43,247 INFO [Listener at jenkins-hbase4.apache.org/46199] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:43,354 INFO [Listener at jenkins-hbase4.apache.org/46199] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:43,361 INFO [Listener at jenkins-hbase4.apache.org/46199] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33375 2023-07-12 22:13:43,877 WARN [Listener at jenkins-hbase4.apache.org/35739] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:43,902 WARN [Listener at jenkins-hbase4.apache.org/35739] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 22:13:43,902 INFO [Listener at jenkins-hbase4.apache.org/35739] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:43,907 INFO [Listener at jenkins-hbase4.apache.org/35739] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36711_node____.ylmdm6/webapp 2023-07-12 22:13:43,960 INFO [Listener at jenkins-hbase4.apache.org/35739] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 22:13:43,960 INFO [Listener at jenkins-hbase4.apache.org/35739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 22:13:43,961 INFO [Listener at jenkins-hbase4.apache.org/35739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 22:13:43,961 INFO [Listener at jenkins-hbase4.apache.org/35739] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 22:13:43,970 INFO [Listener at jenkins-hbase4.apache.org/35739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:43,992 INFO [Listener at jenkins-hbase4.apache.org/35739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:44,055 INFO [Listener at jenkins-hbase4.apache.org/35739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:44,067 INFO [Listener at jenkins-hbase4.apache.org/35739] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36711 2023-07-12 22:13:44,151 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:13:44,310 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 22:13:44,312 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 22:13:44,313 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 22:13:44,415 WARN [Listener at jenkins-hbase4.apache.org/46373] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 22:13:44,421 WARN [Listener at jenkins-hbase4.apache.org/46373] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 22:13:44,421 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 22:13:44,449 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45101_node____.238fld/webapp 2023-07-12 22:13:44,488 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:13:44,489 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 22:13:44,489 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:13:44,490 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 22:13:44,490 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 22:13:44,490 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 22:13:44,490 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:13:44,490 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 22:13:44,490 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 22:13:44,490 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 22:13:44,534 INFO [Listener at jenkins-hbase4.apache.org/46373] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 22:13:44,535 INFO [Listener at jenkins-hbase4.apache.org/46373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 22:13:44,535 INFO [Listener at jenkins-hbase4.apache.org/46373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 22:13:44,535 INFO [Listener at jenkins-hbase4.apache.org/46373] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 22:13:44,544 INFO [Listener at jenkins-hbase4.apache.org/46373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:44,564 INFO [Listener at jenkins-hbase4.apache.org/46373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:44,672 INFO [Listener at jenkins-hbase4.apache.org/46373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 22:13:44,690 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45101 2023-07-12 22:13:44,716 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 22:13:44,718 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:13:44,791 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=174, AvailableMemoryMB=6605 2023-07-12 22:13:44,791 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-12 22:13:44,805 DEBUG [Listener at jenkins-hbase4.apache.org/46373] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 22:13:44,811 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 22:13:44,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:13:44,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:13:44,824 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:13:44,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 22:13:44,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:44,830 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:13:44,835 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251 2023-07-12 22:13:44,835 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d 2023-07-12 22:13:44,837 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d empty. 2023-07-12 22:13:44,837 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251 empty. 2023-07-12 22:13:44,838 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251 2023-07-12 22:13:44,840 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d 2023-07-12 22:13:44,840 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 22:13:44,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:45,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:45,283 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 22:13:45,286 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => cf50d7dcfe642930512a43d389b24251, NAME => 'testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:13:45,286 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 14b81141a8243c1735f0561fc785428d, NAME => 'testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:13:45,325 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:45,326 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing cf50d7dcfe642930512a43d389b24251, disabling compactions & flushes 2023-07-12 22:13:45,326 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:45,327 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:45,327 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. after waiting 0 ms 2023-07-12 22:13:45,327 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:45,327 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:45,327 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for cf50d7dcfe642930512a43d389b24251: 2023-07-12 22:13:45,332 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:45,333 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 14b81141a8243c1735f0561fc785428d, disabling compactions & flushes 2023-07-12 22:13:45,333 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:45,333 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:45,333 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. after waiting 0 ms 2023-07-12 22:13:45,333 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:45,333 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:45,333 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 14b81141a8243c1735f0561fc785428d: 2023-07-12 22:13:45,338 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:13:45,339 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200025339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200025339"}]},"ts":"1689200025339"} 2023-07-12 22:13:45,339 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200025339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200025339"}]},"ts":"1689200025339"} 2023-07-12 22:13:45,393 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:13:45,394 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:13:45,395 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200025394"}]},"ts":"1689200025394"} 2023-07-12 22:13:45,397 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 22:13:45,403 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:13:45,405 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:13:45,405 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:13:45,405 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:13:45,405 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:13:45,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf50d7dcfe642930512a43d389b24251, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14b81141a8243c1735f0561fc785428d, ASSIGN}] 2023-07-12 22:13:45,408 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14b81141a8243c1735f0561fc785428d, ASSIGN 2023-07-12 22:13:45,409 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf50d7dcfe642930512a43d389b24251, ASSIGN 2023-07-12 22:13:45,411 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf50d7dcfe642930512a43d389b24251, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34577,1689200015954; forceNewPlan=false, retain=false 2023-07-12 22:13:45,411 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14b81141a8243c1735f0561fc785428d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45649,1689200015893; forceNewPlan=false, retain=false 2023-07-12 22:13:45,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:45,561 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:13:45,564 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=14b81141a8243c1735f0561fc785428d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:45,564 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cf50d7dcfe642930512a43d389b24251, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:45,565 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200025564"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200025564"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200025564"}]},"ts":"1689200025564"} 2023-07-12 22:13:45,565 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200025564"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200025564"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200025564"}]},"ts":"1689200025564"} 2023-07-12 22:13:45,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 14b81141a8243c1735f0561fc785428d, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:13:45,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure cf50d7dcfe642930512a43d389b24251, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:13:45,726 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:45,726 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:13:45,743 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:13:45,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 14b81141a8243c1735f0561fc785428d, NAME => 'testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:13:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. service=AccessControlService 2023-07-12 22:13:45,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 14b81141a8243c1735f0561fc785428d 2023-07-12 22:13:45,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:45,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 14b81141a8243c1735f0561fc785428d 2023-07-12 22:13:45,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 14b81141a8243c1735f0561fc785428d 2023-07-12 22:13:45,751 INFO [StoreOpener-14b81141a8243c1735f0561fc785428d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 14b81141a8243c1735f0561fc785428d 2023-07-12 22:13:45,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:45,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf50d7dcfe642930512a43d389b24251, NAME => 'testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:13:45,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. service=AccessControlService 2023-07-12 22:13:45,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:13:45,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName cf50d7dcfe642930512a43d389b24251 2023-07-12 22:13:45,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:13:45,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf50d7dcfe642930512a43d389b24251 2023-07-12 22:13:45,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf50d7dcfe642930512a43d389b24251 2023-07-12 22:13:45,761 DEBUG [StoreOpener-14b81141a8243c1735f0561fc785428d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/cf 2023-07-12 22:13:45,761 DEBUG [StoreOpener-14b81141a8243c1735f0561fc785428d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/cf 2023-07-12 22:13:45,762 INFO [StoreOpener-14b81141a8243c1735f0561fc785428d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14b81141a8243c1735f0561fc785428d columnFamilyName cf 2023-07-12 22:13:45,763 INFO [StoreOpener-14b81141a8243c1735f0561fc785428d-1] regionserver.HStore(310): Store=14b81141a8243c1735f0561fc785428d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:45,766 INFO [StoreOpener-cf50d7dcfe642930512a43d389b24251-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf50d7dcfe642930512a43d389b24251 2023-07-12 22:13:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d 2023-07-12 22:13:45,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d 2023-07-12 22:13:45,771 DEBUG [StoreOpener-cf50d7dcfe642930512a43d389b24251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/cf 2023-07-12 22:13:45,771 DEBUG [StoreOpener-cf50d7dcfe642930512a43d389b24251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/cf 2023-07-12 22:13:45,772 INFO [StoreOpener-cf50d7dcfe642930512a43d389b24251-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf50d7dcfe642930512a43d389b24251 columnFamilyName cf 2023-07-12 22:13:45,773 INFO [StoreOpener-cf50d7dcfe642930512a43d389b24251-1] regionserver.HStore(310): Store=cf50d7dcfe642930512a43d389b24251/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:13:45,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251 2023-07-12 22:13:45,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251 2023-07-12 22:13:45,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 14b81141a8243c1735f0561fc785428d 2023-07-12 22:13:45,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf50d7dcfe642930512a43d389b24251 2023-07-12 22:13:45,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:45,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 14b81141a8243c1735f0561fc785428d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63515985, jitterRate=-0.05353806912899017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:45,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 14b81141a8243c1735f0561fc785428d: 2023-07-12 22:13:45,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:13:45,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d., pid=15, masterSystemTime=1689200025722 2023-07-12 22:13:45,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf50d7dcfe642930512a43d389b24251; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61858651, jitterRate=-0.07823427021503448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:13:45,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf50d7dcfe642930512a43d389b24251: 2023-07-12 22:13:45,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251., pid=16, masterSystemTime=1689200025726 2023-07-12 22:13:45,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:45,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:45,802 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=14b81141a8243c1735f0561fc785428d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:45,802 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200025802"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200025802"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200025802"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200025802"}]},"ts":"1689200025802"} 2023-07-12 22:13:45,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:45,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:45,812 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cf50d7dcfe642930512a43d389b24251, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:45,813 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200025812"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200025812"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200025812"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200025812"}]},"ts":"1689200025812"} 2023-07-12 22:13:45,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 22:13:45,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 14b81141a8243c1735f0561fc785428d, server=jenkins-hbase4.apache.org,45649,1689200015893 in 241 msec 2023-07-12 22:13:45,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14b81141a8243c1735f0561fc785428d, ASSIGN in 411 msec 2023-07-12 22:13:45,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 22:13:45,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure cf50d7dcfe642930512a43d389b24251, server=jenkins-hbase4.apache.org,34577,1689200015954 in 247 msec 2023-07-12 22:13:45,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-12 22:13:45,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf50d7dcfe642930512a43d389b24251, ASSIGN in 417 msec 2023-07-12 22:13:45,827 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:13:45,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200025827"}]},"ts":"1689200025827"} 2023-07-12 22:13:45,829 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 22:13:45,832 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:13:45,838 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 22:13:45,859 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 22:13:45,901 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 22:13:45,901 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 22:13:45,901 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 22:13:45,901 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 22:13:45,902 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:13:45,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 22:13:45,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 22:13:45,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 22:13:45,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 22:13:45,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.1010 sec 2023-07-12 22:13:45,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 22:13:45,933 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 22:13:45,934 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-12 22:13:45,935 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:13:45,948 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-12 22:13:45,949 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:13:45,949 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-12 22:13:45,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:45,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200025977 (current time:1689200025977). 2023-07-12 22:13:45,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:13:45,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x4c73780d to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:45,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@792898b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:45,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:45,993 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:45,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c73780d to 127.0.0.1:50879 2023-07-12 22:13:45,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:13:45,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x2c4bb6eb to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:46,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db93c34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:46,101 DEBUG [hconnection-0x1733e1b4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:46,105 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:46,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c4bb6eb to 127.0.0.1:50879 2023-07-12 22:13:46,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:13:46,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 22:13:46,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:13:46,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:46,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:46,163 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:46,165 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689200626165 2023-07-12 22:13:46,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:46,167 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 22:13:46,169 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:46,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:46,176 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:13:46,176 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:13:46,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-12 22:13:46,178 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:46,180 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689200626179 2023-07-12 22:13:46,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,218 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 22:13:46,218 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:46,219 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 22:13:46,219 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 22:13:46,220 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,220 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,226 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:46,226 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:46,226 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:46,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:46,226 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:46,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:46,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:46,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:46,227 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,227 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,227 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,227 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:13:46,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 22:13:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 22:13:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 22:13:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,229 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:46,229 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:46,229 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:46,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,236 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,245 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:46,245 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:46,245 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:46,245 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:46,248 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:46,248 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:46,248 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:46,248 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:46,248 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:46,252 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,253 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,253 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,253 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,253 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,253 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:46,253 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:46,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 22:13:46,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54d5a76c[Count = 1] remaining members to acquire global barrier 2023-07-12 22:13:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:46,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:46,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:46,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 22:13:46,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54d5a76c[Count = 0] remaining members to acquire global barrier 2023-07-12 22:13:46,262 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 22:13:46,262 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:46,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,265 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:46,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,265 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:46,266 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:46,266 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:13:46,266 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,266 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:13:46,267 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:13:46,267 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:13:46,267 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:46,267 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. started... 2023-07-12 22:13:46,270 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:13:46,270 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:13:46,270 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:46,270 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. started... 2023-07-12 22:13:46,273 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:46,273 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:46,273 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:46,275 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf50d7dcfe642930512a43d389b24251: 2023-07-12 22:13:46,275 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 14b81141a8243c1735f0561fc785428d: 2023-07-12 22:13:46,276 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,276 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,276 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:46,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:46,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:13:46,282 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:13:46,283 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:13:46,283 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:13:46,287 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:13:46,287 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:13:46,347 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. completed. 2023-07-12 22:13:46,348 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:46,348 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:13:46,348 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:13:46,348 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,348 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:46,349 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:13:46,351 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:46,351 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,351 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:46,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,351 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:46,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:46,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:46,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:46,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:46,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:46,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45649,1689200015893': 2023-07-12 22:13:46,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 22:13:46,483 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:46,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:46,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:13:46,485 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:13:46,754 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. completed. 2023-07-12 22:13:46,754 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:46,754 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:13:46,754 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:13:46,754 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,754 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:46,754 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:13:46,756 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,756 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:46,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:46,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:46,756 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:46,756 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:46,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:46,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:46,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:13:46,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 22:13:46,762 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 22:13:46,762 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:13:46,762 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:13:46,762 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,762 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:13:46,765 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,765 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,765 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:46,765 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,765 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,765 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:46,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:46,765 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:46,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:46,766 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,767 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,767 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:46,769 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,770 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,770 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:46,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:46,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:46,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,782 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:46,783 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:46,782 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:46,783 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:46,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:46,783 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:46,784 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:46,784 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:46,784 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:46,784 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:46,785 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:46,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:46,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:46,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:46,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:13:46,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,787 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 22:13:46,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 22:13:46,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,880 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 22:13:46,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689200026167Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689200026783 (+616 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689200026783Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689200026798 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689200026822 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689200026879 (+57 ms) 2023-07-12 22:13:46,882 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:46,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 709 msec 2023-07-12 22:13:47,287 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:47,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:47,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:13:47,313 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,318 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34577] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:13:47,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45649] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:13:47,326 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 22:13:47,327 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:47,329 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:13:47,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:47,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200027360 (current time:1689200027360). 2023-07-12 22:13:47,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:13:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x0e498ccf to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:47,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a1ac935, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:47,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,376 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e498ccf to 127.0.0.1:50879 2023-07-12 22:13:47,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:13:47,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x5a9f1a7a to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:13:47,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18f2da12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:13:47,482 DEBUG [hconnection-0x43dfb58-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:13:47,485 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:13:47,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a9f1a7a to 127.0.0.1:50879 2023-07-12 22:13:47,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:13:47,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 22:13:47,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:13:47,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:47,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:47,501 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:47,504 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689200627504 2023-07-12 22:13:47,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 22:13:47,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 22:13:47,506 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:13:47,506 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:13:47,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:47,508 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 22:13:47,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 11 msec 2023-07-12 22:13:47,513 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:47,514 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689200627514 2023-07-12 22:13:47,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 22:13:47,549 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 22:13:47,549 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,551 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 22:13:47,551 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 22:13:47,601 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,601 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,603 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,603 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,603 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,603 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,603 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,603 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,604 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,604 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:13:47,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 22:13:47,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 22:13:47,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,605 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:47,605 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:47,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 22:13:47,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 22:13:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,608 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:47,608 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:47,608 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:47,608 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:47,610 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 22:13:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,610 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:47,610 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:47,610 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 22:13:47,611 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 22:13:47,611 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 22:13:47,611 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:13:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 22:13:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 22:13:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 22:13:47,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:13:47,613 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:13:47,615 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,615 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:47,615 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,616 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,616 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,616 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:47,616 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,616 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:13:47,619 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,619 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 22:13:47,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e245976[Count = 1] remaining members to acquire global barrier 2023-07-12 22:13:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 22:13:47,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e245976[Count = 0] remaining members to acquire global barrier 2023-07-12 22:13:47,626 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 22:13:47,626 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,630 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,630 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,630 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,630 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:47,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:47,631 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:13:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:13:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:13:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,631 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 22:13:47,631 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,631 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. started... 2023-07-12 22:13:47,631 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:13:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:13:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:13:47,631 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:47,631 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. started... 2023-07-12 22:13:47,631 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 14b81141a8243c1735f0561fc785428d 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-12 22:13:47,632 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cf50d7dcfe642930512a43d389b24251 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-12 22:13:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:47,745 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/.tmp/cf/5cf1138f16144ed9822801911f5752d0 2023-07-12 22:13:47,745 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/.tmp/cf/4d5c11e9737041a8976319f7d5459e44 2023-07-12 22:13:47,801 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/.tmp/cf/4d5c11e9737041a8976319f7d5459e44 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/cf/4d5c11e9737041a8976319f7d5459e44 2023-07-12 22:13:47,801 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/.tmp/cf/5cf1138f16144ed9822801911f5752d0 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/cf/5cf1138f16144ed9822801911f5752d0 2023-07-12 22:13:47,811 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/cf/5cf1138f16144ed9822801911f5752d0, entries=1, sequenceid=6, filesize=4.9 K 2023-07-12 22:13:47,811 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/cf/4d5c11e9737041a8976319f7d5459e44, entries=49, sequenceid=6, filesize=8.1 K 2023-07-12 22:13:47,813 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:47,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:47,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:13:47,815 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for cf50d7dcfe642930512a43d389b24251 in 183ms, sequenceid=6, compaction requested=false 2023-07-12 22:13:47,815 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 14b81141a8243c1735f0561fc785428d in 184ms, sequenceid=6, compaction requested=false 2023-07-12 22:13:47,815 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 22:13:47,815 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 22:13:47,816 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:13:47,819 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf50d7dcfe642930512a43d389b24251: 2023-07-12 22:13:47,819 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 14b81141a8243c1735f0561fc785428d: 2023-07-12 22:13:47,819 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 22:13:47,819 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 22:13:47,819 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:13:47,819 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:13:47,819 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/cf/5cf1138f16144ed9822801911f5752d0] hfiles 2023-07-12 22:13:47,819 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/cf/4d5c11e9737041a8976319f7d5459e44] hfiles 2023-07-12 22:13:47,820 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/cf/5cf1138f16144ed9822801911f5752d0 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 22:13:47,820 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/cf/4d5c11e9737041a8976319f7d5459e44 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 22:13:47,846 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. completed. 2023-07-12 22:13:47,847 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:13:47,847 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:13:47,847 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:13:47,847 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,847 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:47,847 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:13:47,848 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. completed. 2023-07-12 22:13:47,848 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:13:47,848 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:13:47,848 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:13:47,848 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,848 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 22:13:47,848 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:13:47,850 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:47,851 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,851 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:47,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,851 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:47,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,854 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,854 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 22:13:47,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,854 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:47,854 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 22:13:47,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45649,1689200015893': 2023-07-12 22:13:47,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 22:13:47,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:13:47,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 22:13:47,866 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 22:13:47,866 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:13:47,866 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:13:47,866 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 22:13:47,866 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:13:47,869 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,869 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,869 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,869 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,869 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,869 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,869 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:13:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:13:47,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,870 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:13:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,871 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,872 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:13:47,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,875 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:13:47,875 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 22:13:47,876 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,893 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,893 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,893 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,893 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,893 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 22:13:47,893 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:13:47,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 22:13:47,894 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,893 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:13:47,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:13:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:13:47,893 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,897 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,893 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:13:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,897 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,898 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:13:47,898 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,898 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:13:47,898 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:13:47,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:13:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:13:47,898 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,899 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 22:13:47,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 22:13:48,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,010 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 22:13:48,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689200027504Consolidate snapshot: snaptb0-testExportWithTargetName at 1689200027894 (+390 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689200027898 (+4 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689200027904 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689200027932 (+28 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689200028009 (+77 ms) 2023-07-12 22:13:48,013 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 22:13:48,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 507 msec 2023-07-12 22:13:48,117 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:13:48,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 22:13:48,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:13:48,121 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121 2023-07-12 22:13:48,121 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34859, tgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121, rawTgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121, srcFsUri=hdfs://localhost:34859, srcDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:13:48,168 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:13:48,169 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1551580128_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 22:13:48,169 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3, snapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 22:13:48,189 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 22:13:48,264 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,265 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,266 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,267 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,267 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,268 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,268 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,376 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop-2370308071906458819.jar 2023-07-12 22:13:48,377 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,378 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,379 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,379 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,380 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,381 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:13:48,381 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:13:48,382 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:13:48,383 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:13:48,383 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:13:48,384 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:13:48,385 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:13:48,385 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:13:48,386 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:13:48,387 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:13:48,388 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:13:48,392 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:13:48,392 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:13:48,393 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:13:48,393 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:13:48,394 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:13:48,395 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:13:48,395 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:13:49,329 WARN [Listener at jenkins-hbase4.apache.org/46373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:13:49,335 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 22:13:49,345 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 22:13:49,936 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:13:49,938 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:13:50,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0001_000001 (auth:SIMPLE) 2023-07-12 22:13:51,254 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:13:55,458 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0001_000001 (auth:SIMPLE) 2023-07-12 22:13:57,695 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0001_000001 (auth:SIMPLE) 2023-07-12 22:14:01,206 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0001_000001 (auth:SIMPLE) 2023-07-12 22:14:03,309 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:14:03,314 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:14:03,324 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 22:14:03,324 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:14:03,325 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:14:03,325 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 22:14:03,326 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 22:14:03,326 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 22:14:03,326 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121/.hbase-snapshot/testExportWithTargetName 2023-07-12 22:14:03,326 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 22:14:03,327 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200028121/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 22:14:03,337 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 22:14:03,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-12 22:14:03,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,355 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200043355"}]},"ts":"1689200043355"} 2023-07-12 22:14:03,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 22:14:03,357 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 22:14:03,360 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 22:14:03,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf50d7dcfe642930512a43d389b24251, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14b81141a8243c1735f0561fc785428d, UNASSIGN}] 2023-07-12 22:14:03,364 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14b81141a8243c1735f0561fc785428d, UNASSIGN 2023-07-12 22:14:03,364 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf50d7dcfe642930512a43d389b24251, UNASSIGN 2023-07-12 22:14:03,365 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=14b81141a8243c1735f0561fc785428d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:03,366 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200043365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200043365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200043365"}]},"ts":"1689200043365"} 2023-07-12 22:14:03,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cf50d7dcfe642930512a43d389b24251, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:03,366 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200043366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200043366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200043366"}]},"ts":"1689200043366"} 2023-07-12 22:14:03,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 14b81141a8243c1735f0561fc785428d, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:14:03,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure cf50d7dcfe642930512a43d389b24251, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:14:03,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 22:14:03,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 14b81141a8243c1735f0561fc785428d 2023-07-12 22:14:03,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cf50d7dcfe642930512a43d389b24251 2023-07-12 22:14:03,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 14b81141a8243c1735f0561fc785428d, disabling compactions & flushes 2023-07-12 22:14:03,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf50d7dcfe642930512a43d389b24251, disabling compactions & flushes 2023-07-12 22:14:03,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:14:03,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:14:03,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:14:03,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:14:03,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. after waiting 0 ms 2023-07-12 22:14:03,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. after waiting 0 ms 2023-07-12 22:14:03,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:14:03,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:14:03,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:03,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:03,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:03,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:03,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251. 2023-07-12 22:14:03,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d. 2023-07-12 22:14:03,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf50d7dcfe642930512a43d389b24251: 2023-07-12 22:14:03,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 14b81141a8243c1735f0561fc785428d: 2023-07-12 22:14:03,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 14b81141a8243c1735f0561fc785428d 2023-07-12 22:14:03,562 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=14b81141a8243c1735f0561fc785428d, regionState=CLOSED 2023-07-12 22:14:03,562 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200043562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200043562"}]},"ts":"1689200043562"} 2023-07-12 22:14:03,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cf50d7dcfe642930512a43d389b24251 2023-07-12 22:14:03,563 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cf50d7dcfe642930512a43d389b24251, regionState=CLOSED 2023-07-12 22:14:03,564 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689200043563"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200043563"}]},"ts":"1689200043563"} 2023-07-12 22:14:03,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-12 22:14:03,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 14b81141a8243c1735f0561fc785428d, server=jenkins-hbase4.apache.org,45649,1689200015893 in 197 msec 2023-07-12 22:14:03,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-12 22:14:03,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure cf50d7dcfe642930512a43d389b24251, server=jenkins-hbase4.apache.org,34577,1689200015954 in 197 msec 2023-07-12 22:14:03,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14b81141a8243c1735f0561fc785428d, UNASSIGN in 213 msec 2023-07-12 22:14:03,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-12 22:14:03,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf50d7dcfe642930512a43d389b24251, UNASSIGN in 214 msec 2023-07-12 22:14:03,579 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200043579"}]},"ts":"1689200043579"} 2023-07-12 22:14:03,581 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 22:14:03,584 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 22:14:03,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 240 msec 2023-07-12 22:14:03,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 22:14:03,660 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 22:14:03,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-12 22:14:03,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,678 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 22:14:03,680 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,684 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 22:14:03,686 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,687 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,687 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,687 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,688 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251 2023-07-12 22:14:03,688 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 22:14:03,688 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d 2023-07-12 22:14:03,688 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 22:14:03,689 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 22:14:03,689 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 22:14:03,690 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,690 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:03,690 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,690 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,690 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:03,690 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:03,691 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 22:14:03,691 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:03,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 22:14:03,695 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/recovered.edits] 2023-07-12 22:14:03,695 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/recovered.edits] 2023-07-12 22:14:03,704 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/cf/4d5c11e9737041a8976319f7d5459e44 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/cf/4d5c11e9737041a8976319f7d5459e44 2023-07-12 22:14:03,704 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/cf/5cf1138f16144ed9822801911f5752d0 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/cf/5cf1138f16144ed9822801911f5752d0 2023-07-12 22:14:03,710 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251/recovered.edits/9.seqid 2023-07-12 22:14:03,710 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d/recovered.edits/9.seqid 2023-07-12 22:14:03,711 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/14b81141a8243c1735f0561fc785428d 2023-07-12 22:14:03,712 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportWithTargetName/cf50d7dcfe642930512a43d389b24251 2023-07-12 22:14:03,712 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 22:14:03,715 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,743 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 22:14:03,746 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 22:14:03,748 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,748 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 22:14:03,748 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200043748"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:03,749 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200043748"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:03,753 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:14:03,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cf50d7dcfe642930512a43d389b24251, NAME => 'testtb-testExportWithTargetName,,1689200024818.cf50d7dcfe642930512a43d389b24251.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 14b81141a8243c1735f0561fc785428d, NAME => 'testtb-testExportWithTargetName,1,1689200024818.14b81141a8243c1735f0561fc785428d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:14:03,753 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 22:14:03,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200043753"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:03,755 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 22:14:03,759 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 22:14:03,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 92 msec 2023-07-12 22:14:03,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 22:14:03,796 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 22:14:03,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 22:14:03,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 22:14:03,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 22:14:03,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 22:14:03,852 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=757 (was 708) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101980767_1 at /127.0.0.1:40910 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:40928 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:49088 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1717740785) connection to jenkins-hbase4.apache.org/172.31.14.131:46835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1717740785) connection to jenkins-hbase4.apache.org/172.31.14.131:46373 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101980767_1 at /127.0.0.1:49066 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (1717740785) connection to jenkins-hbase4.apache.org/172.31.14.131:43529 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=432 (was 294) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=4845 (was 6605) 2023-07-12 22:14:03,852 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-12 22:14:03,874 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=432, ProcessCount=180, AvailableMemoryMB=4843 2023-07-12 22:14:03,874 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-12 22:14:03,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:14:03,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:03,881 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:14:03,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 22:14:03,882 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:14:03,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 22:14:03,885 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:03,885 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:03,886 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290 empty. 2023-07-12 22:14:03,886 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82 empty. 2023-07-12 22:14:03,886 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:03,886 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:03,886 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 22:14:03,900 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 22:14:03,901 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f3866ce5323c14f8bca74cda4be42290, NAME => 'testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:14:03,902 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2f516dfacdf825e4f9ad9ac7b4442a82, NAME => 'testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:14:03,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:03,917 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:03,918 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f3866ce5323c14f8bca74cda4be42290, disabling compactions & flushes 2023-07-12 22:14:03,918 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2f516dfacdf825e4f9ad9ac7b4442a82, disabling compactions & flushes 2023-07-12 22:14:03,918 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:03,918 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:03,918 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:03,918 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:03,919 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. after waiting 0 ms 2023-07-12 22:14:03,919 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. after waiting 0 ms 2023-07-12 22:14:03,919 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:03,919 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:03,919 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:03,919 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:03,919 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f3866ce5323c14f8bca74cda4be42290: 2023-07-12 22:14:03,919 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2f516dfacdf825e4f9ad9ac7b4442a82: 2023-07-12 22:14:03,922 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:14:03,923 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200043923"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200043923"}]},"ts":"1689200043923"} 2023-07-12 22:14:03,923 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200043923"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200043923"}]},"ts":"1689200043923"} 2023-07-12 22:14:03,926 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:14:03,927 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:14:03,927 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200043927"}]},"ts":"1689200043927"} 2023-07-12 22:14:03,929 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 22:14:03,932 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:14:03,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:14:03,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:14:03,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:14:03,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:14:03,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3866ce5323c14f8bca74cda4be42290, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2f516dfacdf825e4f9ad9ac7b4442a82, ASSIGN}] 2023-07-12 22:14:03,936 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3866ce5323c14f8bca74cda4be42290, ASSIGN 2023-07-12 22:14:03,936 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2f516dfacdf825e4f9ad9ac7b4442a82, ASSIGN 2023-07-12 22:14:03,937 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3866ce5323c14f8bca74cda4be42290, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34577,1689200015954; forceNewPlan=false, retain=false 2023-07-12 22:14:03,937 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2f516dfacdf825e4f9ad9ac7b4442a82, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45649,1689200015893; forceNewPlan=false, retain=false 2023-07-12 22:14:03,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 22:14:04,088 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:14:04,090 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2f516dfacdf825e4f9ad9ac7b4442a82, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,090 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f3866ce5323c14f8bca74cda4be42290, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,091 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200044090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200044090"}]},"ts":"1689200044090"} 2023-07-12 22:14:04,091 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200044090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200044090"}]},"ts":"1689200044090"} 2023-07-12 22:14:04,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure f3866ce5323c14f8bca74cda4be42290, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:14:04,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 2f516dfacdf825e4f9ad9ac7b4442a82, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:14:04,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 22:14:04,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:04,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f3866ce5323c14f8bca74cda4be42290, NAME => 'testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:14:04,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. service=AccessControlService 2023-07-12 22:14:04,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:04,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f516dfacdf825e4f9ad9ac7b4442a82, NAME => 'testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:14:04,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:04,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:04,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:04,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:04,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:04,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. service=AccessControlService 2023-07-12 22:14:04,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:04,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:04,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:04,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:04,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:04,251 INFO [StoreOpener-f3866ce5323c14f8bca74cda4be42290-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:04,251 INFO [StoreOpener-2f516dfacdf825e4f9ad9ac7b4442a82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:04,253 DEBUG [StoreOpener-f3866ce5323c14f8bca74cda4be42290-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/cf 2023-07-12 22:14:04,253 DEBUG [StoreOpener-2f516dfacdf825e4f9ad9ac7b4442a82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/cf 2023-07-12 22:14:04,253 DEBUG [StoreOpener-2f516dfacdf825e4f9ad9ac7b4442a82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/cf 2023-07-12 22:14:04,253 DEBUG [StoreOpener-f3866ce5323c14f8bca74cda4be42290-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/cf 2023-07-12 22:14:04,253 INFO [StoreOpener-f3866ce5323c14f8bca74cda4be42290-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3866ce5323c14f8bca74cda4be42290 columnFamilyName cf 2023-07-12 22:14:04,253 INFO [StoreOpener-2f516dfacdf825e4f9ad9ac7b4442a82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f516dfacdf825e4f9ad9ac7b4442a82 columnFamilyName cf 2023-07-12 22:14:04,254 INFO [StoreOpener-f3866ce5323c14f8bca74cda4be42290-1] regionserver.HStore(310): Store=f3866ce5323c14f8bca74cda4be42290/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:04,256 INFO [StoreOpener-2f516dfacdf825e4f9ad9ac7b4442a82-1] regionserver.HStore(310): Store=2f516dfacdf825e4f9ad9ac7b4442a82/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:04,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:04,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:04,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:04,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:04,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:04,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:04,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:04,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:04,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f3866ce5323c14f8bca74cda4be42290; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74487486, jitterRate=0.10995003581047058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:04,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f3866ce5323c14f8bca74cda4be42290: 2023-07-12 22:14:04,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f516dfacdf825e4f9ad9ac7b4442a82; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74825003, jitterRate=0.11497943103313446}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:04,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f516dfacdf825e4f9ad9ac7b4442a82: 2023-07-12 22:14:04,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290., pid=30, masterSystemTime=1689200044245 2023-07-12 22:14:04,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82., pid=31, masterSystemTime=1689200044246 2023-07-12 22:14:04,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:04,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:04,268 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f3866ce5323c14f8bca74cda4be42290, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:04,268 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044268"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200044268"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200044268"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200044268"}]},"ts":"1689200044268"} 2023-07-12 22:14:04,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:04,269 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2f516dfacdf825e4f9ad9ac7b4442a82, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,270 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200044269"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200044269"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200044269"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200044269"}]},"ts":"1689200044269"} 2023-07-12 22:14:04,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-12 22:14:04,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure f3866ce5323c14f8bca74cda4be42290, server=jenkins-hbase4.apache.org,34577,1689200015954 in 178 msec 2023-07-12 22:14:04,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-12 22:14:04,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 2f516dfacdf825e4f9ad9ac7b4442a82, server=jenkins-hbase4.apache.org,45649,1689200015893 in 178 msec 2023-07-12 22:14:04,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3866ce5323c14f8bca74cda4be42290, ASSIGN in 341 msec 2023-07-12 22:14:04,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-12 22:14:04,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2f516dfacdf825e4f9ad9ac7b4442a82, ASSIGN in 343 msec 2023-07-12 22:14:04,281 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:14:04,281 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200044281"}]},"ts":"1689200044281"} 2023-07-12 22:14:04,283 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 22:14:04,286 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:14:04,287 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 22:14:04,290 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:14:04,291 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:04,291 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:04,291 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:04,292 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:04,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:04,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:04,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:04,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:04,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 416 msec 2023-07-12 22:14:04,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 22:14:04,487 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 22:14:04,488 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 22:14:04,488 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:04,492 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 22:14:04,492 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:04,493 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-12 22:14:04,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:04,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200044496 (current time:1689200044496). 2023-07-12 22:14:04,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:04,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x27e54cce to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:04,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@519f5e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:04,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:04,511 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:04,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27e54cce to 127.0.0.1:50879 2023-07-12 22:14:04,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:04,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x17649edd to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:04,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25e64d94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:04,523 DEBUG [hconnection-0x47cf79f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:04,524 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:04,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17649edd to 127.0.0.1:50879 2023-07-12 22:14:04,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:04,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:14:04,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:04,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:04,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:04,534 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:04,535 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689200644535 2023-07-12 22:14:04,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:04,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 22:14:04,536 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:04,536 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:04,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:04,538 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:04,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 22:14:04,540 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:04,541 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689200644541 2023-07-12 22:14:04,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,562 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 22:14:04,562 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,563 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 22:14:04,564 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 22:14:04,564 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,564 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,566 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,566 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,566 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,566 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,566 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,566 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,567 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,567 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:04,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:04,575 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,575 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:04,580 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 22:14:04,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9ee7432[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 22:14:04,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9ee7432[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:04,584 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 22:14:04,584 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:04,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,586 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:04,586 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:04,586 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:04,587 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:04,587 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,587 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:04,586 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:04,586 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:04,587 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. started... 2023-07-12 22:14:04,587 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:04,587 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:14:04,587 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:04,587 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:04,588 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f516dfacdf825e4f9ad9ac7b4442a82: 2023-07-12 22:14:04,588 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. started... 2023-07-12 22:14:04,589 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,589 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f3866ce5323c14f8bca74cda4be42290: 2023-07-12 22:14:04,590 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:04,590 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:04,590 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,590 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:04,590 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:04,591 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:04,591 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:04,591 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:04,607 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. completed. 2023-07-12 22:14:04,608 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:04,608 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:04,608 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:04,608 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,608 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:04,608 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:14:04,610 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,610 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,610 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:04,610 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:04,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,612 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. completed. 2023-07-12 22:14:04,612 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:04,612 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,613 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:04,613 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,613 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:04,613 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:14:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,615 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,615 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:04,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,615 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:04,616 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:14:04,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 22:14:04,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45649,1689200015893': 2023-07-12 22:14:04,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 22:14:04,622 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 22:14:04,622 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:04,622 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:04,622 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,622 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:04,624 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,624 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:04,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,624 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,624 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,624 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,625 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,625 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,625 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:04,626 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,626 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:04,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,628 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,629 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,629 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,632 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,633 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:04,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,633 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:04,633 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:04,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,633 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,634 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,635 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,635 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,635 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:04,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:04,637 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:04,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:14:04,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:04,638 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:04,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 22:14:04,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,693 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:04,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689200044535Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689200044633 (+98 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689200044633Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689200044638 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689200044654 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689200044692 (+38 ms) 2023-07-12 22:14:04,696 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:04,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 160 msec 2023-07-12 22:14:04,838 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:04,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:14:04,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:04,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:04,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45649] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:04,882 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 22:14:04,882 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:04,883 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:04,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:04,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200044898 (current time:1689200044898). 2023-07-12 22:14:04,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:04,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x45bf9ea6 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:04,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@660b74f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:04,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:04,911 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:04,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45bf9ea6 to 127.0.0.1:50879 2023-07-12 22:14:04,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:04,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x1abf950a to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:04,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e5d2e28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:04,934 DEBUG [hconnection-0x354e4174-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:04,937 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:04,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1abf950a to 127.0.0.1:50879 2023-07-12 22:14:04,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:04,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:14:04,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:04,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:04,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:04,949 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:04,950 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689200644950 2023-07-12 22:14:04,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:14:04,950 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 22:14:04,952 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:04,952 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:04,953 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:14:04,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:04,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-12 22:14:04,956 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:04,957 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689200644957 2023-07-12 22:14:04,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 22:14:04,981 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 22:14:04,981 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,983 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 22:14:04,983 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 22:14:04,983 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,983 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,985 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,985 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,985 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:04,985 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:04,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:04,991 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,991 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,991 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:04,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,991 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:04,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 22:14:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 22:14:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:04,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:04,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 22:14:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 22:14:04,993 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:04,993 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,993 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 22:14:04,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 22:14:04,993 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:04,993 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 22:14:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 22:14:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:04,997 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:04,997 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:04,998 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 22:14:04,998 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 22:14:04,998 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 22:14:05,000 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,000 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,001 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,001 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:05,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 22:14:05,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a8e52b7[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 22:14:05,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a8e52b7[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:05,006 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 22:14:05,007 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,010 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,010 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,010 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,011 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,010 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:05,010 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:14:05,011 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,011 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:05,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:14:05,011 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:05,011 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. started... 2023-07-12 22:14:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:05,011 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:05,012 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f3866ce5323c14f8bca74cda4be42290 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 22:14:05,011 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. started... 2023-07-12 22:14:05,012 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2f516dfacdf825e4f9ad9ac7b4442a82 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 22:14:05,012 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:05,012 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:05,012 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:05,048 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/.tmp/cf/5bad30844368434eb383ac98cf95affc 2023-07-12 22:14:05,049 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/.tmp/cf/ce5c372da6004f03b8054565239c00e4 2023-07-12 22:14:05,052 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:05,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:14:05,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:05,055 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:05,059 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/.tmp/cf/ce5c372da6004f03b8054565239c00e4 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/cf/ce5c372da6004f03b8054565239c00e4 2023-07-12 22:14:05,059 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/.tmp/cf/5bad30844368434eb383ac98cf95affc as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/cf/5bad30844368434eb383ac98cf95affc 2023-07-12 22:14:05,068 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/cf/5bad30844368434eb383ac98cf95affc, entries=47, sequenceid=6, filesize=8 K 2023-07-12 22:14:05,068 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/cf/ce5c372da6004f03b8054565239c00e4, entries=3, sequenceid=6, filesize=5.0 K 2023-07-12 22:14:05,071 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f3866ce5323c14f8bca74cda4be42290 in 60ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:05,071 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 2f516dfacdf825e4f9ad9ac7b4442a82 in 59ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:05,071 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 22:14:05,071 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f3866ce5323c14f8bca74cda4be42290: 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f516dfacdf825e4f9ad9ac7b4442a82: 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/cf/ce5c372da6004f03b8054565239c00e4] hfiles 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/cf/5bad30844368434eb383ac98cf95affc] hfiles 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/cf/ce5c372da6004f03b8054565239c00e4 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 22:14:05,074 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/cf/5bad30844368434eb383ac98cf95affc for snapshot=snaptb0-testExportFileSystemState 2023-07-12 22:14:05,084 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. completed. 2023-07-12 22:14:05,084 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:14:05,085 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. completed. 2023-07-12 22:14:05,085 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:05,085 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:05,085 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:05,085 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,085 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 22:14:05,085 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:14:05,089 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:05,090 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,090 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:05,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,090 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:05,093 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,093 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 22:14:05,093 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:05,093 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 22:14:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:14:05,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 22:14:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45649,1689200015893': 2023-07-12 22:14:05,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 22:14:05,101 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 22:14:05,101 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:05,101 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:05,101 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 22:14:05,101 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:05,103 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,103 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,103 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,103 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,103 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,103 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,104 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,103 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,104 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,105 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,107 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:05,107 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 22:14:05,108 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,111 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:05,111 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,111 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 22:14:05,111 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:05,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 22:14:05,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:05,111 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,111 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:05,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:05,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:05,111 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,112 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,112 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,112 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:05,112 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,112 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:05,112 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:05,112 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,112 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:05,111 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,113 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:05,114 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:05,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:05,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:05,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:05,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:05,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 22:14:05,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,200 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689200044950Consolidate snapshot: snaptb0-testExportFileSystemState at 1689200045111 (+161 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689200045111Writing data manifest for snaptb0-testExportFileSystemState at 1689200045118 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689200045137 (+19 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689200045199 (+62 ms) 2023-07-12 22:14:05,203 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 22:14:05,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 252 msec 2023-07-12 22:14:05,256 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:05,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:14:05,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:05,263 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263 2023-07-12 22:14:05,263 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34859, tgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263, rawTgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263, srcFsUri=hdfs://localhost:34859, srcDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:14:05,294 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:14:05,294 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-23317910_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,294 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3, snapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 22:14:05,332 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 22:14:05,384 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,385 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,386 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,386 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,387 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,387 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,388 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,472 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop-3750142926885225824.jar 2023-07-12 22:14:05,472 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,473 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,473 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,473 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,474 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,474 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:05,475 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:14:05,475 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:14:05,475 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:14:05,476 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:14:05,476 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:14:05,477 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:14:05,477 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:14:05,477 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:14:05,477 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:14:05,478 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:14:05,478 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:05,479 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:05,479 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:05,480 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:05,480 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:05,480 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:05,481 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:06,275 WARN [Listener at jenkins-hbase4.apache.org/46373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:14:06,279 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 22:14:06,290 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 22:14:07,450 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:07,451 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:07,458 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0001_000001 (auth:SIMPLE) 2023-07-12 22:14:08,166 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:09,161 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:14:12,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:14,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:18,018 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:19,539 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:14:19,540 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:14:19,548 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 22:14:19,548 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:14:19,548 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:14:19,549 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 22:14:19,549 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 22:14:19,549 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 22:14:19,549 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 22:14:19,550 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 22:14:19,550 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200045263/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 22:14:19,557 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 22:14:19,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-12 22:14:19,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:19,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 22:14:19,563 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200059563"}]},"ts":"1689200059563"} 2023-07-12 22:14:19,565 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 22:14:19,567 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 22:14:19,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3866ce5323c14f8bca74cda4be42290, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2f516dfacdf825e4f9ad9ac7b4442a82, UNASSIGN}] 2023-07-12 22:14:19,570 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3866ce5323c14f8bca74cda4be42290, UNASSIGN 2023-07-12 22:14:19,570 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2f516dfacdf825e4f9ad9ac7b4442a82, UNASSIGN 2023-07-12 22:14:19,571 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f3866ce5323c14f8bca74cda4be42290, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:19,571 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200059571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200059571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200059571"}]},"ts":"1689200059571"} 2023-07-12 22:14:19,571 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2f516dfacdf825e4f9ad9ac7b4442a82, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:19,571 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200059571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200059571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200059571"}]},"ts":"1689200059571"} 2023-07-12 22:14:19,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure f3866ce5323c14f8bca74cda4be42290, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:14:19,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 2f516dfacdf825e4f9ad9ac7b4442a82, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:14:19,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 22:14:19,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:19,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f3866ce5323c14f8bca74cda4be42290, disabling compactions & flushes 2023-07-12 22:14:19,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:19,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:19,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. after waiting 0 ms 2023-07-12 22:14:19,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:19,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:19,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f516dfacdf825e4f9ad9ac7b4442a82, disabling compactions & flushes 2023-07-12 22:14:19,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:19,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:19,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. after waiting 0 ms 2023-07-12 22:14:19,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:19,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:19,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:19,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:19,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:19,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290. 2023-07-12 22:14:19,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f3866ce5323c14f8bca74cda4be42290: 2023-07-12 22:14:19,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82. 2023-07-12 22:14:19,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f516dfacdf825e4f9ad9ac7b4442a82: 2023-07-12 22:14:19,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:19,745 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f3866ce5323c14f8bca74cda4be42290, regionState=CLOSED 2023-07-12 22:14:19,745 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200059745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200059745"}]},"ts":"1689200059745"} 2023-07-12 22:14:19,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:19,746 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2f516dfacdf825e4f9ad9ac7b4442a82, regionState=CLOSED 2023-07-12 22:14:19,746 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689200059746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200059746"}]},"ts":"1689200059746"} 2023-07-12 22:14:19,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-12 22:14:19,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure f3866ce5323c14f8bca74cda4be42290, server=jenkins-hbase4.apache.org,34577,1689200015954 in 174 msec 2023-07-12 22:14:19,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-12 22:14:19,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 2f516dfacdf825e4f9ad9ac7b4442a82, server=jenkins-hbase4.apache.org,45649,1689200015893 in 175 msec 2023-07-12 22:14:19,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3866ce5323c14f8bca74cda4be42290, UNASSIGN in 182 msec 2023-07-12 22:14:19,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-12 22:14:19,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2f516dfacdf825e4f9ad9ac7b4442a82, UNASSIGN in 183 msec 2023-07-12 22:14:19,754 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200059754"}]},"ts":"1689200059754"} 2023-07-12 22:14:19,755 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 22:14:19,763 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 22:14:19,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 205 msec 2023-07-12 22:14:19,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 22:14:19,866 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 22:14:19,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-12 22:14:19,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:19,871 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:19,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 22:14:19,872 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:19,874 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 22:14:19,877 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:19,877 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:19,877 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:19,877 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:19,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 22:14:19,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 22:14:19,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 22:14:19,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 22:14:19,878 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:19,878 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:19,879 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:19,879 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:19,879 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:19,879 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:19,879 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:19,879 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 22:14:19,879 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:19,879 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:19,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 22:14:19,881 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/recovered.edits] 2023-07-12 22:14:19,882 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/recovered.edits] 2023-07-12 22:14:19,888 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/cf/ce5c372da6004f03b8054565239c00e4 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/cf/ce5c372da6004f03b8054565239c00e4 2023-07-12 22:14:19,892 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/cf/5bad30844368434eb383ac98cf95affc to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/cf/5bad30844368434eb383ac98cf95affc 2023-07-12 22:14:19,896 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290/recovered.edits/9.seqid 2023-07-12 22:14:19,897 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/f3866ce5323c14f8bca74cda4be42290 2023-07-12 22:14:19,898 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82/recovered.edits/9.seqid 2023-07-12 22:14:19,899 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemState/2f516dfacdf825e4f9ad9ac7b4442a82 2023-07-12 22:14:19,899 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 22:14:19,905 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:19,908 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 22:14:19,913 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 22:14:19,916 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:19,916 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 22:14:19,916 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200059916"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:19,916 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200059916"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:19,922 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:14:19,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f3866ce5323c14f8bca74cda4be42290, NAME => 'testtb-testExportFileSystemState,,1689200043876.f3866ce5323c14f8bca74cda4be42290.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2f516dfacdf825e4f9ad9ac7b4442a82, NAME => 'testtb-testExportFileSystemState,1,1689200043876.2f516dfacdf825e4f9ad9ac7b4442a82.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:14:19,923 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 22:14:19,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200059923"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:19,927 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 22:14:19,930 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 22:14:19,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 63 msec 2023-07-12 22:14:19,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 22:14:19,983 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 22:14:19,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 22:14:19,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 22:14:19,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 22:14:19,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 22:14:20,032 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 757) Potentially hanging thread: Thread-2066 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:44152 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:48992 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1717740785) connection to jenkins-hbase4.apache.org/172.31.14.131:34187 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_589517171_1 at /127.0.0.1:44126 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_589517171_1 at /127.0.0.1:41302 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:41324 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 432), ProcessCount=177 (was 180), AvailableMemoryMB=4674 (was 4843) 2023-07-12 22:14:20,033 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-12 22:14:20,063 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=177, AvailableMemoryMB=4673 2023-07-12 22:14:20,064 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-12 22:14:20,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:14:20,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:20,072 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:14:20,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 22:14:20,074 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:14:20,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 22:14:20,077 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:20,079 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819 empty. 2023-07-12 22:14:20,079 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:20,079 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:20,079 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900 empty. 2023-07-12 22:14:20,080 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:20,080 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 22:14:20,114 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 22:14:20,119 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3ae5673255ba7a89f6c5496ea0d9e819, NAME => 'testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:14:20,119 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => f4a82923bfa9baedc7b5e0dd9831c900, NAME => 'testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:14:20,180 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:20,180 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 3ae5673255ba7a89f6c5496ea0d9e819, disabling compactions & flushes 2023-07-12 22:14:20,180 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:20,180 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:20,180 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. after waiting 0 ms 2023-07-12 22:14:20,180 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:20,180 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:20,180 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 3ae5673255ba7a89f6c5496ea0d9e819: 2023-07-12 22:14:20,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 22:14:20,181 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:20,181 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing f4a82923bfa9baedc7b5e0dd9831c900, disabling compactions & flushes 2023-07-12 22:14:20,182 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:20,182 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:20,182 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. after waiting 0 ms 2023-07-12 22:14:20,182 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:20,182 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:20,182 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for f4a82923bfa9baedc7b5e0dd9831c900: 2023-07-12 22:14:20,185 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:14:20,187 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060187"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200060187"}]},"ts":"1689200060187"} 2023-07-12 22:14:20,188 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060187"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200060187"}]},"ts":"1689200060187"} 2023-07-12 22:14:20,191 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:14:20,194 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:14:20,195 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200060195"}]},"ts":"1689200060195"} 2023-07-12 22:14:20,196 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 22:14:20,205 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:14:20,207 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:14:20,207 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:14:20,207 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:14:20,207 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:14:20,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ae5673255ba7a89f6c5496ea0d9e819, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f4a82923bfa9baedc7b5e0dd9831c900, ASSIGN}] 2023-07-12 22:14:20,210 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f4a82923bfa9baedc7b5e0dd9831c900, ASSIGN 2023-07-12 22:14:20,210 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ae5673255ba7a89f6c5496ea0d9e819, ASSIGN 2023-07-12 22:14:20,211 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f4a82923bfa9baedc7b5e0dd9831c900, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45649,1689200015893; forceNewPlan=false, retain=false 2023-07-12 22:14:20,211 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ae5673255ba7a89f6c5496ea0d9e819, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34577,1689200015954; forceNewPlan=false, retain=false 2023-07-12 22:14:20,361 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:14:20,364 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f4a82923bfa9baedc7b5e0dd9831c900, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,364 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3ae5673255ba7a89f6c5496ea0d9e819, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,364 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060364"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200060364"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200060364"}]},"ts":"1689200060364"} 2023-07-12 22:14:20,364 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060364"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200060364"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200060364"}]},"ts":"1689200060364"} 2023-07-12 22:14:20,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure f4a82923bfa9baedc7b5e0dd9831c900, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:14:20,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 3ae5673255ba7a89f6c5496ea0d9e819, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:14:20,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 22:14:20,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:20,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4a82923bfa9baedc7b5e0dd9831c900, NAME => 'testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:14:20,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. service=AccessControlService 2023-07-12 22:14:20,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:20,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:20,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ae5673255ba7a89f6c5496ea0d9e819, NAME => 'testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:14:20,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:20,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:20,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:20,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. service=AccessControlService 2023-07-12 22:14:20,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:20,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:20,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:20,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:20,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:20,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:20,524 INFO [StoreOpener-f4a82923bfa9baedc7b5e0dd9831c900-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:20,524 INFO [StoreOpener-3ae5673255ba7a89f6c5496ea0d9e819-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:20,526 DEBUG [StoreOpener-f4a82923bfa9baedc7b5e0dd9831c900-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/cf 2023-07-12 22:14:20,526 DEBUG [StoreOpener-f4a82923bfa9baedc7b5e0dd9831c900-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/cf 2023-07-12 22:14:20,526 DEBUG [StoreOpener-3ae5673255ba7a89f6c5496ea0d9e819-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/cf 2023-07-12 22:14:20,526 DEBUG [StoreOpener-3ae5673255ba7a89f6c5496ea0d9e819-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/cf 2023-07-12 22:14:20,526 INFO [StoreOpener-f4a82923bfa9baedc7b5e0dd9831c900-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4a82923bfa9baedc7b5e0dd9831c900 columnFamilyName cf 2023-07-12 22:14:20,526 INFO [StoreOpener-3ae5673255ba7a89f6c5496ea0d9e819-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ae5673255ba7a89f6c5496ea0d9e819 columnFamilyName cf 2023-07-12 22:14:20,527 INFO [StoreOpener-3ae5673255ba7a89f6c5496ea0d9e819-1] regionserver.HStore(310): Store=3ae5673255ba7a89f6c5496ea0d9e819/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:20,527 INFO [StoreOpener-f4a82923bfa9baedc7b5e0dd9831c900-1] regionserver.HStore(310): Store=f4a82923bfa9baedc7b5e0dd9831c900/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:20,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:20,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:20,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:20,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:20,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:20,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:20,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:20,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:20,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f4a82923bfa9baedc7b5e0dd9831c900; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73576736, jitterRate=0.09637880325317383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:20,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3ae5673255ba7a89f6c5496ea0d9e819; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62082013, jitterRate=-0.07490591704845428}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:20,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f4a82923bfa9baedc7b5e0dd9831c900: 2023-07-12 22:14:20,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3ae5673255ba7a89f6c5496ea0d9e819: 2023-07-12 22:14:20,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900., pid=45, masterSystemTime=1689200060518 2023-07-12 22:14:20,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819., pid=46, masterSystemTime=1689200060519 2023-07-12 22:14:20,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:20,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:20,537 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f4a82923bfa9baedc7b5e0dd9831c900, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:20,537 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060537"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200060537"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200060537"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200060537"}]},"ts":"1689200060537"} 2023-07-12 22:14:20,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:20,537 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3ae5673255ba7a89f6c5496ea0d9e819, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,538 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200060537"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200060537"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200060537"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200060537"}]},"ts":"1689200060537"} 2023-07-12 22:14:20,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-12 22:14:20,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure f4a82923bfa9baedc7b5e0dd9831c900, server=jenkins-hbase4.apache.org,45649,1689200015893 in 173 msec 2023-07-12 22:14:20,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-12 22:14:20,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 3ae5673255ba7a89f6c5496ea0d9e819, server=jenkins-hbase4.apache.org,34577,1689200015954 in 173 msec 2023-07-12 22:14:20,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f4a82923bfa9baedc7b5e0dd9831c900, ASSIGN in 334 msec 2023-07-12 22:14:20,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-12 22:14:20,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ae5673255ba7a89f6c5496ea0d9e819, ASSIGN in 335 msec 2023-07-12 22:14:20,545 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:14:20,545 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200060545"}]},"ts":"1689200060545"} 2023-07-12 22:14:20,546 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 22:14:20,548 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:14:20,549 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 22:14:20,550 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 22:14:20,552 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,552 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,552 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,552 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:20,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:20,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:20,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:20,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:20,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 489 msec 2023-07-12 22:14:20,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 22:14:20,683 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 22:14:20,683 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-12 22:14:20,683 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:20,686 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-12 22:14:20,686 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:20,687 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-12 22:14:20,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:20,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200060689 (current time:1689200060689). 2023-07-12 22:14:20,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:20,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x5948c4bb to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:20,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@698404d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:20,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:20,699 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:20,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5948c4bb to 127.0.0.1:50879 2023-07-12 22:14:20,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:20,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x69981d0b to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:20,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@766a719f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:20,707 DEBUG [hconnection-0x3f011147-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:20,710 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:20,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69981d0b to 127.0.0.1:50879 2023-07-12 22:14:20,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:20,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 22:14:20,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:20,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:20,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:20,718 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:20,719 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689200660719 2023-07-12 22:14:20,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:20,719 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 22:14:20,720 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:20,720 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:20,721 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:20,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:20,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-12 22:14:20,724 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:20,724 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689200660724 2023-07-12 22:14:20,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,736 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 22:14:20,736 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:20,737 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 22:14:20,737 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 22:14:20,738 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,738 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,745 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,745 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:20,745 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:20,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:20,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:20,745 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:20,745 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:20,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:20,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:20,745 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,746 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,746 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:20,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 22:14:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 22:14:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:20,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:20,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,747 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:20,747 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 22:14:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,747 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:20,747 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:20,748 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:20,749 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:20,749 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:20,749 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:20,749 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:20,749 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:20,749 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:20,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,749 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:20,749 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:20,755 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,755 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:20,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:20,755 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,756 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,756 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,756 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:20,756 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,756 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:20,756 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:20,756 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,756 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:20,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:20,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:20,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 22:14:20,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@496fa119[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:20,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:20,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:20,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:20,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:20,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:20,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 22:14:20,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@496fa119[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:20,761 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 22:14:20,761 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,762 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,762 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:20,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,763 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,763 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:20,763 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:20,763 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:20,763 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:20,763 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. started... 2023-07-12 22:14:20,763 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:20,763 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:20,763 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:20,763 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:14:20,764 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4a82923bfa9baedc7b5e0dd9831c900: 2023-07-12 22:14:20,764 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:20,764 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:20,764 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:20,764 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,764 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. started... 2023-07-12 22:14:20,764 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:20,765 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:20,766 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae5673255ba7a89f6c5496ea0d9e819: 2023-07-12 22:14:20,766 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,767 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:20,767 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:20,772 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:20,772 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:20,772 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:20,782 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. completed. 2023-07-12 22:14:20,782 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:20,782 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:20,782 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:20,782 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,784 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:20,784 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:14:20,786 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:20,786 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,786 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:20,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:20,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:20,787 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:20,788 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. completed. 2023-07-12 22:14:20,788 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:20,788 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:20,788 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:20,788 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,788 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:20,788 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:14:20,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:20,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:20,790 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,790 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:20,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,790 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:20,790 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:20,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:20,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45649,1689200015893': 2023-07-12 22:14:20,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 22:14:20,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:20,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:20,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:20,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:20,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:20,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:14:20,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 22:14:20,798 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 22:14:20,798 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:20,798 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:20,798 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,798 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:20,801 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:20,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:20,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:20,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:20,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,802 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:20,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:20,803 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:20,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:20,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:20,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:20,804 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:20,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:20,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:20,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,805 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:20,807 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,807 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,807 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,811 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:20,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:20,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:20,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:20,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:20,812 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:20,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,811 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:20,811 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:20,812 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:20,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:20,813 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:20,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,813 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:20,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:20,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:20,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:20,813 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:20,820 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:20,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:20,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:20,822 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:20,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 22:14:20,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,867 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:20,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689200060719Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689200060811 (+92 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689200060812 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689200060816 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689200060825 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689200060866 (+41 ms) 2023-07-12 22:14:20,873 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:20,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 153 msec 2023-07-12 22:14:21,022 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:21,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:21,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:21,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34577] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:21,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45649] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:21,039 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 22:14:21,039 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:21,040 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:21,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:21,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200061051 (current time:1689200061051). 2023-07-12 22:14:21,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:21,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x4bfa3d5a to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:21,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37679539, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:21,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:21,075 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:21,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bfa3d5a to 127.0.0.1:50879 2023-07-12 22:14:21,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:21,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x65fa2c76 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:21,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f70cd7e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:21,115 DEBUG [hconnection-0x743551f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:21,116 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:21,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65fa2c76 to 127.0.0.1:50879 2023-07-12 22:14:21,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:21,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 22:14:21,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:21,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:21,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:21,128 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:21,129 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689200661129 2023-07-12 22:14:21,129 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 22:14:21,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 22:14:21,131 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:21,131 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:21,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:21,132 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 22:14:21,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-12 22:14:21,135 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:21,135 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689200661135 2023-07-12 22:14:21,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 22:14:21,148 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 22:14:21,148 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,152 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 22:14:21,152 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 22:14:21,152 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,152 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,154 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,154 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,154 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,154 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,154 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,154 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,155 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,155 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:21,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 22:14:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 22:14:21,156 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 22:14:21,156 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,156 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:21,158 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:21,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 22:14:21,158 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:21,158 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 22:14:21,158 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,158 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:21,158 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:21,159 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:21,161 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:21,161 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 22:14:21,161 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 22:14:21,161 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:21,161 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 22:14:21,165 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,165 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,165 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,165 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,166 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,166 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,166 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:21,166 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,166 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:21,166 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,166 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:21,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 22:14:21,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e2f2b9a[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 22:14:21,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e2f2b9a[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:21,172 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 22:14:21,172 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:21,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,173 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:21,173 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:21,173 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:21,173 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,174 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. started... 2023-07-12 22:14:21,173 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:21,173 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 22:14:21,174 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:21,174 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:14:21,174 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f4a82923bfa9baedc7b5e0dd9831c900 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-12 22:14:21,174 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:21,174 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:21,174 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,174 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:21,176 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:21,176 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:21,176 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:21,180 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:21,184 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. started... 2023-07-12 22:14:21,184 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3ae5673255ba7a89f6c5496ea0d9e819 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-12 22:14:21,199 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/.tmp/cf/5a54e30349cd4d92b33e715e43e98ea5 2023-07-12 22:14:21,202 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/.tmp/cf/5a77f1e80ca74a33b675fb0d2f5aa732 2023-07-12 22:14:21,207 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/.tmp/cf/5a54e30349cd4d92b33e715e43e98ea5 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/cf/5a54e30349cd4d92b33e715e43e98ea5 2023-07-12 22:14:21,212 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/.tmp/cf/5a77f1e80ca74a33b675fb0d2f5aa732 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/cf/5a77f1e80ca74a33b675fb0d2f5aa732 2023-07-12 22:14:21,214 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/cf/5a54e30349cd4d92b33e715e43e98ea5, entries=49, sequenceid=6, filesize=8.1 K 2023-07-12 22:14:21,216 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for f4a82923bfa9baedc7b5e0dd9831c900 in 41ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:21,216 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 22:14:21,217 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4a82923bfa9baedc7b5e0dd9831c900: 2023-07-12 22:14:21,217 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 22:14:21,217 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:21,217 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/cf/5a54e30349cd4d92b33e715e43e98ea5] hfiles 2023-07-12 22:14:21,217 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/cf/5a54e30349cd4d92b33e715e43e98ea5 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 22:14:21,219 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/cf/5a77f1e80ca74a33b675fb0d2f5aa732, entries=1, sequenceid=6, filesize=4.9 K 2023-07-12 22:14:21,220 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 3ae5673255ba7a89f6c5496ea0d9e819 in 36ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:21,222 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae5673255ba7a89f6c5496ea0d9e819: 2023-07-12 22:14:21,222 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 22:14:21,222 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:21,222 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/cf/5a77f1e80ca74a33b675fb0d2f5aa732] hfiles 2023-07-12 22:14:21,223 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/cf/5a77f1e80ca74a33b675fb0d2f5aa732 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 22:14:21,231 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:21,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:21,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:21,233 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:21,256 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. completed. 2023-07-12 22:14:21,256 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:21,256 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:21,256 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:21,256 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,256 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:21,256 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:14:21,257 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. completed. 2023-07-12 22:14:21,257 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:21,257 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:21,257 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:21,257 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,257 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 22:14:21,257 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:14:21,259 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,259 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:21,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,259 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:21,259 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:21,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,265 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 22:14:21,265 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:21,265 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,265 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 22:14:21,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45649,1689200015893': 2023-07-12 22:14:21,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 22:14:21,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:14:21,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 22:14:21,285 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 22:14:21,285 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:21,285 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:21,285 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 22:14:21,285 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:21,288 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,288 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,288 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,288 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:21,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:21,288 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,289 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,289 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:21,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:21,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:21,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 22:14:21,295 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,298 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,299 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,303 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,303 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,304 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,310 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,310 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,310 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,310 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,310 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,311 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:21,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,311 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,311 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,310 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,311 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:21,310 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:21,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 22:14:21,311 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,313 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:21,313 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,313 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:21,313 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:21,313 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,313 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:21,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 22:14:21,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:21,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:21,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:21,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 22:14:21,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,375 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689200061129Consolidate snapshot: snaptb0-testConsecutiveExports at 1689200061313 (+184 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689200061314 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689200061327 (+13 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689200061344 (+17 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689200061375 (+31 ms) 2023-07-12 22:14:21,378 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 22:14:21,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 248 msec 2023-07-12 22:14:21,433 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:21,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 22:14:21,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:21,435 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435 2023-07-12 22:14:21,435 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435, srcFsUri=hdfs://localhost:34859, srcDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:14:21,459 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:14:21,459 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6d17c1a3, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,459 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3, snapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 22:14:21,467 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:21,479 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,479 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,480 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,480 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,480 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,481 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,481 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,553 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop-3989083454968185860.jar 2023-07-12 22:14:21,553 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,554 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,554 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,554 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,555 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,555 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:21,555 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:14:21,556 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:14:21,556 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:14:21,557 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:14:21,557 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:14:21,558 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:14:21,558 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:14:21,559 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:14:21,559 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:14:21,560 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:14:21,560 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:21,560 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:21,561 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:21,561 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:21,561 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:21,562 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:21,562 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:21,990 WARN [Listener at jenkins-hbase4.apache.org/46373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:14:21,992 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 22:14:21,994 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 22:14:24,189 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:24,189 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:24,192 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0002_000001 (auth:SIMPLE) 2023-07-12 22:14:24,460 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:25,332 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:14:28,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:31,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:34,516 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:36,227 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:14:36,228 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:14:36,231 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 22:14:36,231 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:14:36,232 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:14:36,232 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:36,235 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 22:14:36,235 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 22:14:36,236 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@277ae36a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:36,236 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 22:14:36,236 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 22:14:36,238 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435, srcFsUri=hdfs://localhost:34859, srcDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:14:36,272 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:14:36,272 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@18de93af, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:36,272 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3, snapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 22:14:36,285 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 22:14:36,297 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,298 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,298 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,299 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,299 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,299 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,300 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,378 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop-223025964276349513.jar 2023-07-12 22:14:36,379 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,379 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,380 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,380 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,381 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,381 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:36,382 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:14:36,382 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:14:36,383 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:14:36,384 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:14:36,384 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:14:36,385 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:14:36,385 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:14:36,386 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:14:36,386 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:14:36,387 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:14:36,388 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:36,388 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:36,389 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:36,389 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:36,389 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:36,390 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:36,390 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:37,266 WARN [Listener at jenkins-hbase4.apache.org/46373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:14:37,268 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 22:14:37,271 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 22:14:40,698 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:40,698 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:14:40,701 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0003_000001 (auth:SIMPLE) 2023-07-12 22:14:41,443 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:45,972 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:48,265 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:51,300 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:52,455 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:14:52,456 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:14:52,459 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 22:14:52,459 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:14:52,459 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:14:52,459 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:52,464 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 22:14:52,464 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 22:14:52,464 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@277ae36a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 22:14:52,464 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 22:14:52,464 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/local-export-1689200061435/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 22:14:52,476 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 22:14:52,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-12 22:14:52,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:52,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 22:14:52,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200092481"}]},"ts":"1689200092481"} 2023-07-12 22:14:52,483 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 22:14:52,485 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 22:14:52,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ae5673255ba7a89f6c5496ea0d9e819, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f4a82923bfa9baedc7b5e0dd9831c900, UNASSIGN}] 2023-07-12 22:14:52,488 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ae5673255ba7a89f6c5496ea0d9e819, UNASSIGN 2023-07-12 22:14:52,488 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f4a82923bfa9baedc7b5e0dd9831c900, UNASSIGN 2023-07-12 22:14:52,489 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3ae5673255ba7a89f6c5496ea0d9e819, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:52,489 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f4a82923bfa9baedc7b5e0dd9831c900, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:52,490 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200092489"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200092489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200092489"}]},"ts":"1689200092489"} 2023-07-12 22:14:52,490 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200092489"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200092489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200092489"}]},"ts":"1689200092489"} 2023-07-12 22:14:52,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 3ae5673255ba7a89f6c5496ea0d9e819, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:14:52,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure f4a82923bfa9baedc7b5e0dd9831c900, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:14:52,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 22:14:52,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:52,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:52,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3ae5673255ba7a89f6c5496ea0d9e819, disabling compactions & flushes 2023-07-12 22:14:52,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:52,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f4a82923bfa9baedc7b5e0dd9831c900, disabling compactions & flushes 2023-07-12 22:14:52,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:52,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. after waiting 0 ms 2023-07-12 22:14:52,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:52,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:52,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:52,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. after waiting 0 ms 2023-07-12 22:14:52,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:52,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:52,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:14:52,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:52,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:52,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819. 2023-07-12 22:14:52,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3ae5673255ba7a89f6c5496ea0d9e819: 2023-07-12 22:14:52,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900. 2023-07-12 22:14:52,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f4a82923bfa9baedc7b5e0dd9831c900: 2023-07-12 22:14:52,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:52,669 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f4a82923bfa9baedc7b5e0dd9831c900, regionState=CLOSED 2023-07-12 22:14:52,669 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200092669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200092669"}]},"ts":"1689200092669"} 2023-07-12 22:14:52,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:52,670 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3ae5673255ba7a89f6c5496ea0d9e819, regionState=CLOSED 2023-07-12 22:14:52,670 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689200092670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200092670"}]},"ts":"1689200092670"} 2023-07-12 22:14:52,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-12 22:14:52,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure f4a82923bfa9baedc7b5e0dd9831c900, server=jenkins-hbase4.apache.org,45649,1689200015893 in 178 msec 2023-07-12 22:14:52,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-12 22:14:52,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 3ae5673255ba7a89f6c5496ea0d9e819, server=jenkins-hbase4.apache.org,34577,1689200015954 in 181 msec 2023-07-12 22:14:52,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f4a82923bfa9baedc7b5e0dd9831c900, UNASSIGN in 188 msec 2023-07-12 22:14:52,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-12 22:14:52,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ae5673255ba7a89f6c5496ea0d9e819, UNASSIGN in 189 msec 2023-07-12 22:14:52,677 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200092677"}]},"ts":"1689200092677"} 2023-07-12 22:14:52,678 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 22:14:52,681 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 22:14:52,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 205 msec 2023-07-12 22:14:52,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 22:14:52,784 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 22:14:52,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-12 22:14:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:52,788 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:52,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 22:14:52,789 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:52,792 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 22:14:52,795 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:52,795 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:52,795 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:52,795 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:52,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 22:14:52,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 22:14:52,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 22:14:52,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 22:14:52,796 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:52,796 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:52,797 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:52,797 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:52,797 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:52,797 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:52,797 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 22:14:52,797 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:52,797 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:52,797 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:52,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 22:14:52,799 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/recovered.edits] 2023-07-12 22:14:52,799 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/recovered.edits] 2023-07-12 22:14:52,803 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/cf/5a77f1e80ca74a33b675fb0d2f5aa732 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/cf/5a77f1e80ca74a33b675fb0d2f5aa732 2023-07-12 22:14:52,803 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/cf/5a54e30349cd4d92b33e715e43e98ea5 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/cf/5a54e30349cd4d92b33e715e43e98ea5 2023-07-12 22:14:52,806 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819/recovered.edits/9.seqid 2023-07-12 22:14:52,806 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900/recovered.edits/9.seqid 2023-07-12 22:14:52,807 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/3ae5673255ba7a89f6c5496ea0d9e819 2023-07-12 22:14:52,807 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testConsecutiveExports/f4a82923bfa9baedc7b5e0dd9831c900 2023-07-12 22:14:52,807 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 22:14:52,809 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:52,811 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 22:14:52,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 22:14:52,814 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:52,814 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 22:14:52,814 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200092814"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:52,815 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200092814"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:52,816 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:14:52,816 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3ae5673255ba7a89f6c5496ea0d9e819, NAME => 'testtb-testConsecutiveExports,,1689200060066.3ae5673255ba7a89f6c5496ea0d9e819.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f4a82923bfa9baedc7b5e0dd9831c900, NAME => 'testtb-testConsecutiveExports,1,1689200060066.f4a82923bfa9baedc7b5e0dd9831c900.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:14:52,816 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 22:14:52,816 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200092816"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:52,818 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 22:14:52,820 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 22:14:52,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 35 msec 2023-07-12 22:14:52,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 22:14:52,900 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 22:14:52,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 22:14:52,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 22:14:52,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 22:14:52,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 22:14:52,939 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=746 (was 765), OpenFileDescriptor=892 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=505 (was 430) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 177), AvailableMemoryMB=5247 (was 4673) - AvailableMemoryMB LEAK? - 2023-07-12 22:14:52,940 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-12 22:14:52,960 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=505, ProcessCount=175, AvailableMemoryMB=5238 2023-07-12 22:14:52,960 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-12 22:14:52,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:14:52,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:52,966 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:14:52,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 22:14:52,967 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:14:52,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 22:14:52,969 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85 2023-07-12 22:14:52,969 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:14:52,970 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85 empty. 2023-07-12 22:14:52,970 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6 empty. 2023-07-12 22:14:52,971 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85 2023-07-12 22:14:52,971 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:14:52,971 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 22:14:52,994 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 22:14:52,995 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 78995bea505176a09d56479f29ba8c85, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:14:52,995 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 56c62cc97eb62dd2ae078c1f496b08a6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:14:53,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:53,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 56c62cc97eb62dd2ae078c1f496b08a6, disabling compactions & flushes 2023-07-12 22:14:53,018 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:53,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:53,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. after waiting 0 ms 2023-07-12 22:14:53,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:53,018 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:53,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 56c62cc97eb62dd2ae078c1f496b08a6: 2023-07-12 22:14:53,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:53,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 78995bea505176a09d56479f29ba8c85, disabling compactions & flushes 2023-07-12 22:14:53,027 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:53,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:53,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. after waiting 0 ms 2023-07-12 22:14:53,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:53,027 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:53,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 78995bea505176a09d56479f29ba8c85: 2023-07-12 22:14:53,031 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:14:53,033 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093032"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200093032"}]},"ts":"1689200093032"} 2023-07-12 22:14:53,033 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093032"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200093032"}]},"ts":"1689200093032"} 2023-07-12 22:14:53,041 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:14:53,042 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:14:53,043 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200093042"}]},"ts":"1689200093042"} 2023-07-12 22:14:53,044 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 22:14:53,047 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:14:53,049 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:14:53,049 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:14:53,049 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:14:53,049 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:14:53,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=78995bea505176a09d56479f29ba8c85, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56c62cc97eb62dd2ae078c1f496b08a6, ASSIGN}] 2023-07-12 22:14:53,051 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=78995bea505176a09d56479f29ba8c85, ASSIGN 2023-07-12 22:14:53,051 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56c62cc97eb62dd2ae078c1f496b08a6, ASSIGN 2023-07-12 22:14:53,052 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=78995bea505176a09d56479f29ba8c85, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34131,1689200016023; forceNewPlan=false, retain=false 2023-07-12 22:14:53,052 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56c62cc97eb62dd2ae078c1f496b08a6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45649,1689200015893; forceNewPlan=false, retain=false 2023-07-12 22:14:53,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 22:14:53,202 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:14:53,206 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=78995bea505176a09d56479f29ba8c85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=56c62cc97eb62dd2ae078c1f496b08a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,206 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200093206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200093206"}]},"ts":"1689200093206"} 2023-07-12 22:14:53,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200093206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200093206"}]},"ts":"1689200093206"} 2023-07-12 22:14:53,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 78995bea505176a09d56479f29ba8c85, server=jenkins-hbase4.apache.org,34131,1689200016023}] 2023-07-12 22:14:53,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 56c62cc97eb62dd2ae078c1f496b08a6, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:14:53,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 22:14:53,364 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,364 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:14:53,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:53,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 56c62cc97eb62dd2ae078c1f496b08a6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:14:53,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. service=AccessControlService 2023-07-12 22:14:53,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:53,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:14:53,372 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:14:53,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:53,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:14:53,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:14:53,384 INFO [StoreOpener-56c62cc97eb62dd2ae078c1f496b08a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:14:53,386 DEBUG [StoreOpener-56c62cc97eb62dd2ae078c1f496b08a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/cf 2023-07-12 22:14:53,386 DEBUG [StoreOpener-56c62cc97eb62dd2ae078c1f496b08a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/cf 2023-07-12 22:14:53,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:53,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78995bea505176a09d56479f29ba8c85, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:14:53,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. service=AccessControlService 2023-07-12 22:14:53,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:53,408 INFO [StoreOpener-56c62cc97eb62dd2ae078c1f496b08a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56c62cc97eb62dd2ae078c1f496b08a6 columnFamilyName cf 2023-07-12 22:14:53,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 78995bea505176a09d56479f29ba8c85 2023-07-12 22:14:53,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:53,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 78995bea505176a09d56479f29ba8c85 2023-07-12 22:14:53,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 78995bea505176a09d56479f29ba8c85 2023-07-12 22:14:53,411 INFO [StoreOpener-56c62cc97eb62dd2ae078c1f496b08a6-1] regionserver.HStore(310): Store=56c62cc97eb62dd2ae078c1f496b08a6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:53,415 INFO [StoreOpener-78995bea505176a09d56479f29ba8c85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 78995bea505176a09d56479f29ba8c85 2023-07-12 22:14:53,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:14:53,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:14:53,417 DEBUG [StoreOpener-78995bea505176a09d56479f29ba8c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/cf 2023-07-12 22:14:53,417 DEBUG [StoreOpener-78995bea505176a09d56479f29ba8c85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/cf 2023-07-12 22:14:53,418 INFO [StoreOpener-78995bea505176a09d56479f29ba8c85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78995bea505176a09d56479f29ba8c85 columnFamilyName cf 2023-07-12 22:14:53,419 INFO [StoreOpener-78995bea505176a09d56479f29ba8c85-1] regionserver.HStore(310): Store=78995bea505176a09d56479f29ba8c85/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:53,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:14:53,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85 2023-07-12 22:14:53,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:53,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85 2023-07-12 22:14:53,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 78995bea505176a09d56479f29ba8c85 2023-07-12 22:14:53,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 56c62cc97eb62dd2ae078c1f496b08a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60610112, jitterRate=-0.09683895111083984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:53,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 56c62cc97eb62dd2ae078c1f496b08a6: 2023-07-12 22:14:53,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6., pid=61, masterSystemTime=1689200093364 2023-07-12 22:14:53,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:53,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:53,439 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=56c62cc97eb62dd2ae078c1f496b08a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,439 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093439"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200093439"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200093439"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200093439"}]},"ts":"1689200093439"} 2023-07-12 22:14:53,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:53,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 78995bea505176a09d56479f29ba8c85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60717065, jitterRate=-0.09524522721767426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:53,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 78995bea505176a09d56479f29ba8c85: 2023-07-12 22:14:53,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85., pid=60, masterSystemTime=1689200093364 2023-07-12 22:14:53,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:53,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:53,453 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-12 22:14:53,453 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 56c62cc97eb62dd2ae078c1f496b08a6, server=jenkins-hbase4.apache.org,45649,1689200015893 in 233 msec 2023-07-12 22:14:53,453 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=78995bea505176a09d56479f29ba8c85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,453 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200093453"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200093453"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200093453"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200093453"}]},"ts":"1689200093453"} 2023-07-12 22:14:53,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56c62cc97eb62dd2ae078c1f496b08a6, ASSIGN in 404 msec 2023-07-12 22:14:53,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-12 22:14:53,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 78995bea505176a09d56479f29ba8c85, server=jenkins-hbase4.apache.org,34131,1689200016023 in 246 msec 2023-07-12 22:14:53,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-12 22:14:53,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=78995bea505176a09d56479f29ba8c85, ASSIGN in 408 msec 2023-07-12 22:14:53,460 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:14:53,460 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200093460"}]},"ts":"1689200093460"} 2023-07-12 22:14:53,462 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 22:14:53,464 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:14:53,465 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 22:14:53,467 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 22:14:53,468 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,468 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,470 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,470 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:53,470 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:53,470 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:53,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:53,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:53,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 508 msec 2023-07-12 22:14:53,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 22:14:53,571 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 22:14:53,571 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-12 22:14:53,571 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:53,576 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-12 22:14:53,576 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:53,576 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-12 22:14:53,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:53,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200093583 (current time:1689200093583). 2023-07-12 22:14:53,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:53,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x69df4b55 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:53,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48af99bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:53,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:53,617 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:53,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69df4b55 to 127.0.0.1:50879 2023-07-12 22:14:53,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:53,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x3b7de1ba to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:53,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@286b9063, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:53,629 DEBUG [hconnection-0x1c3db694-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:53,632 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:53,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b7de1ba to 127.0.0.1:50879 2023-07-12 22:14:53,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:53,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 22:14:53,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:53,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:53,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:53,641 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:53,644 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689200693644 2023-07-12 22:14:53,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:53,645 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:53,646 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:53,647 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:53,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:53,648 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-12 22:14:53,649 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:53,649 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689200693649 2023-07-12 22:14:53,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,717 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 22:14:53,717 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:53,719 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 22:14:53,719 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 22:14:53,719 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,719 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,721 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:53,721 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:53,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:53,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:53,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:53,721 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:53,721 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:53,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:53,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:53,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,723 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,723 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,724 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,724 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:53,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:53,724 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:53,725 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:53,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:53,728 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:53,728 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:53,728 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:53,729 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:53,729 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:53,729 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:53,731 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,731 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:53,738 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,738 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,738 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:53,739 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,739 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:53,739 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,739 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:53,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,742 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,742 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:53,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,746 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:53,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:53,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:53,747 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:53,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:53,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 22:14:53,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41a8f89[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:53,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:53,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:53,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:53,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:53,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:53,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 22:14:53,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41a8f89[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:53,752 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 22:14:53,753 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,754 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,754 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,754 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,755 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:53,755 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:53,755 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:14:53,755 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,755 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,755 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:53,763 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:53,763 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:53,763 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:53,766 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:53,768 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:53,768 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:53,769 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. started... 2023-07-12 22:14:53,770 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:53,772 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:53,772 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:53,772 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78995bea505176a09d56479f29ba8c85: 2023-07-12 22:14:53,772 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. started... 2023-07-12 22:14:53,772 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,773 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 56c62cc97eb62dd2ae078c1f496b08a6: 2023-07-12 22:14:53,773 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:53,774 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:53,774 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,774 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:53,774 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:14:53,799 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. completed. 2023-07-12 22:14:53,799 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:53,799 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:53,799 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:53,799 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,799 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:53,799 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:14:53,801 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:53,801 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:53,801 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:53,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:53,801 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:53,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:53,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:53,810 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. completed. 2023-07-12 22:14:53,810 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:53,810 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:53,810 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:53,810 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,811 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:53,811 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:14:53,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,812 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,812 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:53,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,812 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:53,812 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:53,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:53,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34131,1689200016023': 2023-07-12 22:14:53,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 22:14:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45649,1689200015893': 2023-07-12 22:14:53,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 22:14:53,820 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 22:14:53,821 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:53,821 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:53,821 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,821 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:53,826 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,826 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:53,827 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:53,826 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:53,828 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:53,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:53,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,828 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,829 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,831 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,831 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:53,831 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,841 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:53,841 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:53,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:53,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:53,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:53,841 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:53,841 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:53,841 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:53,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:53,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:53,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:53,841 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:53,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:53,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:53,842 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:53,842 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,843 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,844 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,844 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,844 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:53,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:53,844 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,844 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:53,844 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,844 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:53,844 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:53,844 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,845 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:53,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:53,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,947 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:53,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:53,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:53,949 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:14:53,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 22:14:53,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,973 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:53,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689200093644Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689200093842 (+198 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689200093844 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689200093850 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689200093871 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689200093971 (+100 ms) 2023-07-12 22:14:53,976 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:53,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 331 msec 2023-07-12 22:14:54,250 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:54,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:54,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:54,266 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:54,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45649] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:54,275 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:54,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:14:54,279 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,279 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:54,280 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:14:54,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:54,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200094301 (current time:1689200094301). 2023-07-12 22:14:54,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:54,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x05f3408a to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:54,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ed8224b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:54,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:54,324 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:54,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05f3408a to 127.0.0.1:50879 2023-07-12 22:14:54,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:54,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x5954062e to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:54,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@463cfa9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:54,346 DEBUG [hconnection-0x49794268-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:54,352 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:54,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5954062e to 127.0.0.1:50879 2023-07-12 22:14:54,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:54,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 22:14:54,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:54,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:54,376 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:54,377 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689200694377 2023-07-12 22:14:54,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 22:14:54,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,377 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:54,378 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:54,381 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 22:14:54,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:54,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 14 msec 2023-07-12 22:14:54,384 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:54,384 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689200694384 2023-07-12 22:14:54,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,453 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 22:14:54,453 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:54,455 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 22:14:54,455 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 22:14:54,455 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,455 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,456 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,456 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,456 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,456 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,457 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,457 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 22:14:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 22:14:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,458 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:54,458 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,459 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,459 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:54,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:54,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:54,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:54,462 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 22:14:54,461 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:54,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:54,465 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 22:14:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:54,465 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:54,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,465 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 22:14:54,465 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:54,472 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 22:14:54,472 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 22:14:54,472 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 22:14:54,476 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,476 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,476 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,476 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:54,476 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,476 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:54,476 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,476 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,478 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,479 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,479 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:54,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,479 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:54,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:54,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:54,481 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:54,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 22:14:54,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c497e57[Count = 1] remaining members to acquire global barrier 2023-07-12 22:14:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 22:14:54,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c497e57[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:54,489 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 22:14:54,489 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,491 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,491 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:54,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,491 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:54,491 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:14:54,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,492 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 22:14:54,492 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,492 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:54,495 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:54,495 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:54,495 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:54,502 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:54,505 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:54,504 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:54,505 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:54,504 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:54,505 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. started... 2023-07-12 22:14:54,505 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 56c62cc97eb62dd2ae078c1f496b08a6 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 22:14:54,505 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:54,506 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. started... 2023-07-12 22:14:54,506 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 78995bea505176a09d56479f29ba8c85 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 22:14:54,567 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/.tmp/cf/a9bc364cbd2c406a888db9d333cf6c3a 2023-07-12 22:14:54,572 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/.tmp/cf/644edc008d3040739a1f0da5f20d8ab0 2023-07-12 22:14:54,573 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/.tmp/cf/a9bc364cbd2c406a888db9d333cf6c3a as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/cf/a9bc364cbd2c406a888db9d333cf6c3a 2023-07-12 22:14:54,579 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/.tmp/cf/644edc008d3040739a1f0da5f20d8ab0 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/cf/644edc008d3040739a1f0da5f20d8ab0 2023-07-12 22:14:54,580 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/cf/a9bc364cbd2c406a888db9d333cf6c3a, entries=3, sequenceid=6, filesize=5.0 K 2023-07-12 22:14:54,581 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 78995bea505176a09d56479f29ba8c85 in 75ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:54,581 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 22:14:54,582 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78995bea505176a09d56479f29ba8c85: 2023-07-12 22:14:54,582 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,582 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:54,582 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/cf/a9bc364cbd2c406a888db9d333cf6c3a] hfiles 2023-07-12 22:14:54,582 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/cf/a9bc364cbd2c406a888db9d333cf6c3a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,604 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. completed. 2023-07-12 22:14:54,604 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:14:54,604 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:54,605 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:54,605 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,605 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/cf/644edc008d3040739a1f0da5f20d8ab0, entries=47, sequenceid=6, filesize=8 K 2023-07-12 22:14:54,605 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:54,605 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:14:54,606 INFO [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 56c62cc97eb62dd2ae078c1f496b08a6 in 101ms, sequenceid=6, compaction requested=false 2023-07-12 22:14:54,608 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 56c62cc97eb62dd2ae078c1f496b08a6: 2023-07-12 22:14:54,608 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,608 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:54,608 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/cf/644edc008d3040739a1f0da5f20d8ab0] hfiles 2023-07-12 22:14:54,608 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/cf/644edc008d3040739a1f0da5f20d8ab0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,609 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:54,609 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:54,609 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,609 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34131,1689200016023': 2023-07-12 22:14:54,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 22:14:54,626 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. completed. 2023-07-12 22:14:54,626 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:14:54,626 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:54,626 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:54,626 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,626 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 22:14:54,627 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:14:54,628 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,630 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 22:14:54,631 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:54,631 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 22:14:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45649,1689200015893': 2023-07-12 22:14:54,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 22:14:54,635 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 22:14:54,635 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:54,635 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:54,635 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,635 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:54,640 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,640 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,640 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,640 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,641 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,641 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,641 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:54,642 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,643 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:54,644 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:54,646 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,646 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,646 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,658 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,659 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:54,659 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:54,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:54,659 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:54,659 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:54,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,659 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:54,662 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,662 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:54,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,682 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:54,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:54,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:54,685 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:14:54,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,742 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 22:14:54,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,742 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:14:54,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689200094377Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689200094661 (+284 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689200094662 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689200094687 (+25 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689200094703 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689200094742 (+39 ms) 2023-07-12 22:14:54,749 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 22:14:54,750 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 370 msec 2023-07-12 22:14:54,985 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:54,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 22:14:54,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:55,031 DEBUG [Listener at jenkins-hbase4.apache.org/46373] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:14:55,054 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:14:55,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 22:14:55,058 DEBUG [Listener at jenkins-hbase4.apache.org/46373] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:14:55,065 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:14:55,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34577] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 22:14:55,066 DEBUG [Listener at jenkins-hbase4.apache.org/46373] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 22:14:55,077 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 22:14:55,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45649] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 22:14:55,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:14:55,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:55,095 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:14:55,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 22:14:55,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 22:14:55,101 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:14:55,105 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890 2023-07-12 22:14:55,105 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:55,124 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5 empty. 2023-07-12 22:14:55,124 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890 empty. 2023-07-12 22:14:55,125 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:55,125 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890 2023-07-12 22:14:55,125 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 22:14:55,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 22:14:55,224 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 22:14:55,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 091262ac06292b07db1f81632146a890, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:14:55,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6e363fb508cec6d01980b2633b025dc5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:14:55,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:55,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 091262ac06292b07db1f81632146a890, disabling compactions & flushes 2023-07-12 22:14:55,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:55,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:55,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. after waiting 0 ms 2023-07-12 22:14:55,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:55,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:55,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 091262ac06292b07db1f81632146a890: 2023-07-12 22:14:55,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:55,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 6e363fb508cec6d01980b2633b025dc5, disabling compactions & flushes 2023-07-12 22:14:55,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:55,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:55,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. after waiting 0 ms 2023-07-12 22:14:55,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:55,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:55,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 6e363fb508cec6d01980b2633b025dc5: 2023-07-12 22:14:55,293 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:14:55,294 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095294"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200095294"}]},"ts":"1689200095294"} 2023-07-12 22:14:55,294 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095294"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200095294"}]},"ts":"1689200095294"} 2023-07-12 22:14:55,297 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:14:55,298 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:14:55,298 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200095298"}]},"ts":"1689200095298"} 2023-07-12 22:14:55,300 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 22:14:55,306 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:14:55,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:14:55,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:14:55,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:14:55,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:14:55,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=091262ac06292b07db1f81632146a890, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6e363fb508cec6d01980b2633b025dc5, ASSIGN}] 2023-07-12 22:14:55,312 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=091262ac06292b07db1f81632146a890, ASSIGN 2023-07-12 22:14:55,314 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6e363fb508cec6d01980b2633b025dc5, ASSIGN 2023-07-12 22:14:55,316 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=091262ac06292b07db1f81632146a890, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45649,1689200015893; forceNewPlan=false, retain=false 2023-07-12 22:14:55,316 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6e363fb508cec6d01980b2633b025dc5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34131,1689200016023; forceNewPlan=false, retain=false 2023-07-12 22:14:55,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 22:14:55,466 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:14:55,470 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=091262ac06292b07db1f81632146a890, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:55,470 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6e363fb508cec6d01980b2633b025dc5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:55,470 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200095470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200095470"}]},"ts":"1689200095470"} 2023-07-12 22:14:55,470 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200095470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200095470"}]},"ts":"1689200095470"} 2023-07-12 22:14:55,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 091262ac06292b07db1f81632146a890, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:14:55,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 6e363fb508cec6d01980b2633b025dc5, server=jenkins-hbase4.apache.org,34131,1689200016023}] 2023-07-12 22:14:55,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:55,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:55,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 091262ac06292b07db1f81632146a890, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 22:14:55,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6e363fb508cec6d01980b2633b025dc5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. service=AccessControlService 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. service=AccessControlService 2023-07-12 22:14:55,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 091262ac06292b07db1f81632146a890 2023-07-12 22:14:55,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 091262ac06292b07db1f81632146a890 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 091262ac06292b07db1f81632146a890 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:55,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:55,635 INFO [StoreOpener-6e363fb508cec6d01980b2633b025dc5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:55,635 INFO [StoreOpener-091262ac06292b07db1f81632146a890-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 091262ac06292b07db1f81632146a890 2023-07-12 22:14:55,636 DEBUG [StoreOpener-6e363fb508cec6d01980b2633b025dc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/cf 2023-07-12 22:14:55,636 DEBUG [StoreOpener-091262ac06292b07db1f81632146a890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/cf 2023-07-12 22:14:55,636 DEBUG [StoreOpener-091262ac06292b07db1f81632146a890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/cf 2023-07-12 22:14:55,636 DEBUG [StoreOpener-6e363fb508cec6d01980b2633b025dc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/cf 2023-07-12 22:14:55,637 INFO [StoreOpener-091262ac06292b07db1f81632146a890-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 091262ac06292b07db1f81632146a890 columnFamilyName cf 2023-07-12 22:14:55,637 INFO [StoreOpener-6e363fb508cec6d01980b2633b025dc5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e363fb508cec6d01980b2633b025dc5 columnFamilyName cf 2023-07-12 22:14:55,637 INFO [StoreOpener-091262ac06292b07db1f81632146a890-1] regionserver.HStore(310): Store=091262ac06292b07db1f81632146a890/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:55,637 INFO [StoreOpener-6e363fb508cec6d01980b2633b025dc5-1] regionserver.HStore(310): Store=6e363fb508cec6d01980b2633b025dc5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:55,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890 2023-07-12 22:14:55,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:55,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:55,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890 2023-07-12 22:14:55,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:55,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 091262ac06292b07db1f81632146a890 2023-07-12 22:14:55,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:55,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:14:55,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6e363fb508cec6d01980b2633b025dc5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61012305, jitterRate=-0.09084580838680267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:55,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6e363fb508cec6d01980b2633b025dc5: 2023-07-12 22:14:55,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 091262ac06292b07db1f81632146a890; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69537056, jitterRate=0.03618288040161133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:55,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 091262ac06292b07db1f81632146a890: 2023-07-12 22:14:55,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5., pid=70, masterSystemTime=1689200095628 2023-07-12 22:14:55,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890., pid=69, masterSystemTime=1689200095628 2023-07-12 22:14:55,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:55,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:55,647 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6e363fb508cec6d01980b2633b025dc5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:55,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:55,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:55,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095647"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200095647"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200095647"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200095647"}]},"ts":"1689200095647"} 2023-07-12 22:14:55,647 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=091262ac06292b07db1f81632146a890, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:55,648 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200095647"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200095647"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200095647"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200095647"}]},"ts":"1689200095647"} 2023-07-12 22:14:55,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-12 22:14:55,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-12 22:14:55,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 091262ac06292b07db1f81632146a890, server=jenkins-hbase4.apache.org,45649,1689200015893 in 176 msec 2023-07-12 22:14:55,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 6e363fb508cec6d01980b2633b025dc5, server=jenkins-hbase4.apache.org,34131,1689200016023 in 174 msec 2023-07-12 22:14:55,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=091262ac06292b07db1f81632146a890, ASSIGN in 343 msec 2023-07-12 22:14:55,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-12 22:14:55,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6e363fb508cec6d01980b2633b025dc5, ASSIGN in 343 msec 2023-07-12 22:14:55,654 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:14:55,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200095654"}]},"ts":"1689200095654"} 2023-07-12 22:14:55,655 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 22:14:55,688 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:14:55,688 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 22:14:55,691 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 22:14:55,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 22:14:55,725 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:55,725 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:55,725 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:55,725 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:14:55,772 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:55,772 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:55,772 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:55,772 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:55,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:55,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:55,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:55,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 22:14:55,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 692 msec 2023-07-12 22:14:56,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 22:14:56,207 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 22:14:56,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 091262ac06292b07db1f81632146a890, 6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:56,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[091262ac06292b07db1f81632146a890, 6e363fb508cec6d01980b2633b025dc5], force=true 2023-07-12 22:14:56,254 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[091262ac06292b07db1f81632146a890, 6e363fb508cec6d01980b2633b025dc5], force=true 2023-07-12 22:14:56,254 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[091262ac06292b07db1f81632146a890, 6e363fb508cec6d01980b2633b025dc5], force=true 2023-07-12 22:14:56,254 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[091262ac06292b07db1f81632146a890, 6e363fb508cec6d01980b2633b025dc5], force=true 2023-07-12 22:14:56,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:56,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=091262ac06292b07db1f81632146a890, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6e363fb508cec6d01980b2633b025dc5, UNASSIGN}] 2023-07-12 22:14:56,290 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=091262ac06292b07db1f81632146a890, UNASSIGN 2023-07-12 22:14:56,290 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6e363fb508cec6d01980b2633b025dc5, UNASSIGN 2023-07-12 22:14:56,295 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6e363fb508cec6d01980b2633b025dc5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:56,295 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200096295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200096295"}]},"ts":"1689200096295"} 2023-07-12 22:14:56,296 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=091262ac06292b07db1f81632146a890, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:56,297 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096296"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200096296"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200096296"}]},"ts":"1689200096296"} 2023-07-12 22:14:56,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 6e363fb508cec6d01980b2633b025dc5, server=jenkins-hbase4.apache.org,34131,1689200016023}] 2023-07-12 22:14:56,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 091262ac06292b07db1f81632146a890, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:14:56,312 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 22:14:56,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:56,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:56,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6e363fb508cec6d01980b2633b025dc5, disabling compactions & flushes 2023-07-12 22:14:56,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:56,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:56,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. after waiting 0 ms 2023-07-12 22:14:56,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:56,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6e363fb508cec6d01980b2633b025dc5 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 22:14:56,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 091262ac06292b07db1f81632146a890 2023-07-12 22:14:56,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 091262ac06292b07db1f81632146a890, disabling compactions & flushes 2023-07-12 22:14:56,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:56,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:56,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. after waiting 0 ms 2023-07-12 22:14:56,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:56,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 091262ac06292b07db1f81632146a890 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 22:14:56,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/.tmp/cf/ac5cbf39afe74d3887fb5b9049891614 2023-07-12 22:14:56,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/.tmp/cf/ac5cbf39afe74d3887fb5b9049891614 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/cf/ac5cbf39afe74d3887fb5b9049891614 2023-07-12 22:14:56,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/.tmp/cf/249fb943ae924afaa3de1b89df828e9d 2023-07-12 22:14:56,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/cf/ac5cbf39afe74d3887fb5b9049891614, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 22:14:56,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 091262ac06292b07db1f81632146a890 in 43ms, sequenceid=5, compaction requested=false 2023-07-12 22:14:56,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 22:14:56,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:56,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890. 2023-07-12 22:14:56,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 091262ac06292b07db1f81632146a890: 2023-07-12 22:14:56,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 091262ac06292b07db1f81632146a890 2023-07-12 22:14:56,523 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=091262ac06292b07db1f81632146a890, regionState=CLOSED 2023-07-12 22:14:56,523 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200096523"}]},"ts":"1689200096523"} 2023-07-12 22:14:56,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-12 22:14:56,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 091262ac06292b07db1f81632146a890, server=jenkins-hbase4.apache.org,45649,1689200015893 in 217 msec 2023-07-12 22:14:56,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/.tmp/cf/249fb943ae924afaa3de1b89df828e9d as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/cf/249fb943ae924afaa3de1b89df828e9d 2023-07-12 22:14:56,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=091262ac06292b07db1f81632146a890, UNASSIGN in 242 msec 2023-07-12 22:14:56,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/cf/249fb943ae924afaa3de1b89df828e9d, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 22:14:56,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6e363fb508cec6d01980b2633b025dc5 in 76ms, sequenceid=5, compaction requested=false 2023-07-12 22:14:56,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:56,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 22:14:56,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:14:56,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5. 2023-07-12 22:14:56,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6e363fb508cec6d01980b2633b025dc5: 2023-07-12 22:14:56,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:14:56,564 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6e363fb508cec6d01980b2633b025dc5, regionState=CLOSED 2023-07-12 22:14:56,565 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689200096564"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200096564"}]},"ts":"1689200096564"} 2023-07-12 22:14:56,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-12 22:14:56,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 6e363fb508cec6d01980b2633b025dc5, server=jenkins-hbase4.apache.org,34131,1689200016023 in 262 msec 2023-07-12 22:14:56,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-12 22:14:56,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6e363fb508cec6d01980b2633b025dc5, UNASSIGN in 281 msec 2023-07-12 22:14:56,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:57,116 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 22:14:57,119 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095080.091262ac06292b07db1f81632146a890.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:57,120 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689200095080.6e363fb508cec6d01980b2633b025dc5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:57,120 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 22:14:57,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=efc075df34c052fab90a2bb4c81f79af, ASSIGN}] 2023-07-12 22:14:57,229 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=efc075df34c052fab90a2bb4c81f79af, ASSIGN 2023-07-12 22:14:57,235 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=efc075df34c052fab90a2bb4c81f79af, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45649,1689200015893; forceNewPlan=false, retain=false 2023-07-12 22:14:57,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:57,388 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 22:14:57,390 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=efc075df34c052fab90a2bb4c81f79af, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:57,390 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689200097389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200097389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200097389"}]},"ts":"1689200097389"} 2023-07-12 22:14:57,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure efc075df34c052fab90a2bb4c81f79af, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:14:57,408 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0004_000001 (auth:SIMPLE) 2023-07-12 22:14:57,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. 2023-07-12 22:14:57,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => efc075df34c052fab90a2bb4c81f79af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.', STARTKEY => '', ENDKEY => ''} 2023-07-12 22:14:57,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. service=AccessControlService 2023-07-12 22:14:57,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:14:57,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:14:57,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:14:57,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:14:57,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:14:57,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/.regioninfo 2023-07-12 22:14:57,602 INFO [StoreOpener-efc075df34c052fab90a2bb4c81f79af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:14:57,614 DEBUG [StoreOpener-efc075df34c052fab90a2bb4c81f79af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf 2023-07-12 22:14:57,615 DEBUG [StoreOpener-efc075df34c052fab90a2bb4c81f79af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf 2023-07-12 22:14:57,615 INFO [StoreOpener-efc075df34c052fab90a2bb4c81f79af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efc075df34c052fab90a2bb4c81f79af columnFamilyName cf 2023-07-12 22:14:57,655 DEBUG [StoreOpener-efc075df34c052fab90a2bb4c81f79af-1] regionserver.HStore(539): loaded hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/249fb943ae924afaa3de1b89df828e9d.6e363fb508cec6d01980b2633b025dc5->hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/cf/249fb943ae924afaa3de1b89df828e9d-top 2023-07-12 22:14:57,664 DEBUG [StoreOpener-efc075df34c052fab90a2bb4c81f79af-1] regionserver.HStore(539): loaded hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/ac5cbf39afe74d3887fb5b9049891614.091262ac06292b07db1f81632146a890->hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/cf/ac5cbf39afe74d3887fb5b9049891614-top 2023-07-12 22:14:57,665 INFO [StoreOpener-efc075df34c052fab90a2bb4c81f79af-1] regionserver.HStore(310): Store=efc075df34c052fab90a2bb4c81f79af/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:14:57,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:14:57,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:14:57,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:14:57,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened efc075df34c052fab90a2bb4c81f79af; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62357504, jitterRate=-0.07080078125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:14:57,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for efc075df34c052fab90a2bb4c81f79af: 2023-07-12 22:14:57,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af., pid=77, masterSystemTime=1689200097544 2023-07-12 22:14:57,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.,because compaction is disabled. 2023-07-12 22:14:57,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. 2023-07-12 22:14:57,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. 2023-07-12 22:14:57,690 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=efc075df34c052fab90a2bb4c81f79af, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:57,690 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689200097689"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200097689"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200097689"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200097689"}]},"ts":"1689200097689"} 2023-07-12 22:14:57,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 22:14:57,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure efc075df34c052fab90a2bb4c81f79af, server=jenkins-hbase4.apache.org,45649,1689200015893 in 300 msec 2023-07-12 22:14:57,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 22:14:57,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=efc075df34c052fab90a2bb4c81f79af, ASSIGN in 467 msec 2023-07-12 22:14:57,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[091262ac06292b07db1f81632146a890, 6e363fb508cec6d01980b2633b025dc5], force=true in 1.4510 sec 2023-07-12 22:14:58,292 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:14:58,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 22:14:58,366 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 22:14:58,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 22:14:58,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200098367 (current time:1689200098367). 2023-07-12 22:14:58,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:14:58,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x52160e6e to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:58,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e99c994, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:58,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:58,434 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:58,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52160e6e to 127.0.0.1:50879 2023-07-12 22:14:58,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:58,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x436088c7 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:14:58,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21e78bbb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:14:58,493 DEBUG [hconnection-0x192337a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:14:58,497 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:14:58,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x436088c7 to 127.0.0.1:50879 2023-07-12 22:14:58,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:14:58,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 22:14:58,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:14:58,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 22:14:58,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 22:14:58,514 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 22:14:58,518 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689200698518 2023-07-12 22:14:58,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 22:14:58,519 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:14:58,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,519 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:14:58,525 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 22:14:58,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 22:14:58,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 14 msec 2023-07-12 22:14:58,531 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 22:14:58,533 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689200698533 2023-07-12 22:14:58,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,623 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 22:14:58,623 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:58,625 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:58,625 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 22:14:58,625 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 22:14:58,626 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,626 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,628 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:58,628 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:58,628 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:58,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:58,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:58,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:58,628 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:58,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:58,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:58,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,629 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,629 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:14:58,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 22:14:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 22:14:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 22:14:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 22:14:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 22:14:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,631 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 22:14:58,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 22:14:58,631 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 22:14:58,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:58,631 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:58,631 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:14:58,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,640 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 22:14:58,640 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 22:14:58,641 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:58,640 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 22:14:58,641 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 22:14:58,643 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,643 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,643 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:58,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,649 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 22:14:58,649 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 22:14:58,649 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 22:14:58,650 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:14:58,650 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 22:14:58,654 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,654 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:58,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:58,654 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 22:14:58,654 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 22:14:58,654 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 22:14:58,654 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,654 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:58,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:58,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:58,657 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,657 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,658 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:14:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:58,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:58,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 22:14:58,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@789a79ae[Count = 0] remaining members to acquire global barrier 2023-07-12 22:14:58,659 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 22:14:58,659 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 22:14:58,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 22:14:58,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,661 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:14:58,662 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 22:14:58,661 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,661 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 22:14:58,662 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:14:58,662 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 22:14:58,662 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:14:58,662 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:14:58,662 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:14:58,662 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. 2023-07-12 22:14:58,662 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. started... 2023-07-12 22:14:58,664 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for efc075df34c052fab90a2bb4c81f79af: 2023-07-12 22:14:58,664 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 22:14:58,665 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:58,665 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,665 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 22:14:58,665 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:14:58,666 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/249fb943ae924afaa3de1b89df828e9d.6e363fb508cec6d01980b2633b025dc5->hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/cf/249fb943ae924afaa3de1b89df828e9d-top, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/ac5cbf39afe74d3887fb5b9049891614.091262ac06292b07db1f81632146a890->hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/cf/ac5cbf39afe74d3887fb5b9049891614-top] hfiles 2023-07-12 22:14:58,666 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/249fb943ae924afaa3de1b89df828e9d.6e363fb508cec6d01980b2633b025dc5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 22:14:58,667 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/ac5cbf39afe74d3887fb5b9049891614.091262ac06292b07db1f81632146a890 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 22:14:58,712 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. completed. 2023-07-12 22:14:58,712 DEBUG [rs(jenkins-hbase4.apache.org,45649,1689200015893)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. 2023-07-12 22:14:58,712 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:14:58,712 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:14:58,712 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,712 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 22:14:58,712 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:14:58,720 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 22:14:58,720 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:58,720 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 22:14:58,720 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:58,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:58,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:58,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:58,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:58,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:58,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:58,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45649,1689200015893': 2023-07-12 22:14:58,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 22:14:58,729 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 22:14:58,729 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:14:58,730 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:14:58,730 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,730 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:14:58,732 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,732 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,732 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:14:58,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:14:58,732 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,732 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:58,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,732 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:58,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,733 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,733 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:58,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:58,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:14:58,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:58,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:58,733 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:58,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:58,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:58,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:58,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,734 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:58,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:14:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:58,736 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:14:58,737 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:58,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,737 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:58,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:58,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:58,741 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:58,741 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:58,741 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:58,741 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:14:58,741 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:58,741 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:58,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:58,741 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:58,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:14:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:58,742 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:14:58,741 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:58,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,741 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:14:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:14:58,741 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:58,742 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:58,742 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:58,742 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:14:58,742 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,742 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:14:58,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:58,742 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:14:58,742 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,743 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:14:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:14:58,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,832 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:58,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 22:14:58,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:14:58,834 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:14:58,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 22:14:58,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,953 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:58,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689200098519Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689200098742 (+223 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689200098742Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689200098745 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689200098797 (+52 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689200098952 (+155 ms) 2023-07-12 22:14:58,958 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 22:14:58,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 435 msec 2023-07-12 22:14:59,134 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:14:59,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 22:14:59,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:14:59,135 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135 2023-07-12 22:14:59,136 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34859, tgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135, rawTgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135, srcFsUri=hdfs://localhost:34859, srcDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:14:59,161 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:14:59,161 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1547297744_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:59,162 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3, snapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 22:14:59,179 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:14:59,236 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,237 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,237 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,238 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,238 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,238 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,239 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,339 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop-1284484271221996367.jar 2023-07-12 22:14:59,340 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,340 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,341 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,341 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,341 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,342 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:14:59,342 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:14:59,343 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:14:59,343 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:14:59,343 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:14:59,344 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:14:59,344 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:14:59,345 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:14:59,345 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:14:59,346 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:14:59,346 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:14:59,346 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:59,347 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:59,347 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:59,347 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:59,348 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:14:59,348 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:14:59,348 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:00,062 WARN [Listener at jenkins-hbase4.apache.org/46373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:15:00,065 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 22:15:00,067 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 22:15:00,155 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:00,155 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:00,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0005_000001 (auth:SIMPLE) 2023-07-12 22:15:06,365 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0005_000001 (auth:SIMPLE) 2023-07-12 22:15:08,657 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0005_000001 (auth:SIMPLE) 2023-07-12 22:15:15,340 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:15:15,375 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:15:15,403 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,403 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:15:15,404 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:15:15,404 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,405 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 22:15:15,405 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 22:15:15,405 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,406 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 22:15:15,406 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200099135/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 22:15:15,420 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,427 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200115427"}]},"ts":"1689200115427"} 2023-07-12 22:15:15,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 22:15:15,429 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 22:15:15,432 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 22:15:15,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=efc075df34c052fab90a2bb4c81f79af, UNASSIGN}] 2023-07-12 22:15:15,440 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=efc075df34c052fab90a2bb4c81f79af, UNASSIGN 2023-07-12 22:15:15,441 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=efc075df34c052fab90a2bb4c81f79af, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:15,442 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689200115441"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200115441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200115441"}]},"ts":"1689200115441"} 2023-07-12 22:15:15,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure efc075df34c052fab90a2bb4c81f79af, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:15:15,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 22:15:15,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:15:15,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing efc075df34c052fab90a2bb4c81f79af, disabling compactions & flushes 2023-07-12 22:15:15,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. 2023-07-12 22:15:15,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. 2023-07-12 22:15:15,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. after waiting 0 ms 2023-07-12 22:15:15,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. 2023-07-12 22:15:15,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 22:15:15,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:15,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af. 2023-07-12 22:15:15,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for efc075df34c052fab90a2bb4c81f79af: 2023-07-12 22:15:15,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=efc075df34c052fab90a2bb4c81f79af, regionState=CLOSED 2023-07-12 22:15:15,615 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689200115614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200115614"}]},"ts":"1689200115614"} 2023-07-12 22:15:15,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:15:15,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 22:15:15,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure efc075df34c052fab90a2bb4c81f79af, server=jenkins-hbase4.apache.org,45649,1689200015893 in 179 msec 2023-07-12 22:15:15,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 22:15:15,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=efc075df34c052fab90a2bb4c81f79af, UNASSIGN in 189 msec 2023-07-12 22:15:15,629 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200115629"}]},"ts":"1689200115629"} 2023-07-12 22:15:15,631 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 22:15:15,633 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 22:15:15,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 212 msec 2023-07-12 22:15:15,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 22:15:15,739 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 22:15:15,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,744 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,745 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,746 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,750 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,750 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,750 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,750 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 22:15:15,752 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,752 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,752 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,752 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,752 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:15,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:15,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 22:15:15,759 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:15:15,759 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:15:15,759 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890 2023-07-12 22:15:15,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-12 22:15:15,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-12 22:15:15,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-12 22:15:15,760 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 22:15:15,760 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 22:15:15,760 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 22:15:15,761 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:15,761 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:15,761 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:15,764 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/recovered.edits] 2023-07-12 22:15:15,764 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/recovered.edits] 2023-07-12 22:15:15,765 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/recovered.edits] 2023-07-12 22:15:15,769 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/249fb943ae924afaa3de1b89df828e9d.6e363fb508cec6d01980b2633b025dc5 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/249fb943ae924afaa3de1b89df828e9d.6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:15:15,769 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/cf/249fb943ae924afaa3de1b89df828e9d to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/cf/249fb943ae924afaa3de1b89df828e9d 2023-07-12 22:15:15,770 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/cf/ac5cbf39afe74d3887fb5b9049891614 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/cf/ac5cbf39afe74d3887fb5b9049891614 2023-07-12 22:15:15,773 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/ac5cbf39afe74d3887fb5b9049891614.091262ac06292b07db1f81632146a890 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/cf/ac5cbf39afe74d3887fb5b9049891614.091262ac06292b07db1f81632146a890 2023-07-12 22:15:15,775 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/recovered.edits/8.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5/recovered.edits/8.seqid 2023-07-12 22:15:15,775 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/recovered.edits/8.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890/recovered.edits/8.seqid 2023-07-12 22:15:15,776 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6e363fb508cec6d01980b2633b025dc5 2023-07-12 22:15:15,776 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/091262ac06292b07db1f81632146a890 2023-07-12 22:15:15,778 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/recovered.edits/12.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af/recovered.edits/12.seqid 2023-07-12 22:15:15,778 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/efc075df34c052fab90a2bb4c81f79af 2023-07-12 22:15:15,778 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 22:15:15,781 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,783 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 22:15:15,786 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 22:15:15,787 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,787 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 22:15:15,787 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200115787"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:15,797 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 22:15:15,798 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => efc075df34c052fab90a2bb4c81f79af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689200095081.efc075df34c052fab90a2bb4c81f79af.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 22:15:15,798 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 22:15:15,798 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200115798"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:15,800 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 22:15:15,803 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:15,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 63 msec 2023-07-12 22:15:15,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 22:15:15,858 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 22:15:15,858 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:15,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 22:15:15,866 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200115866"}]},"ts":"1689200115866"} 2023-07-12 22:15:15,868 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 22:15:15,870 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 22:15:15,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=78995bea505176a09d56479f29ba8c85, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56c62cc97eb62dd2ae078c1f496b08a6, UNASSIGN}] 2023-07-12 22:15:15,874 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=78995bea505176a09d56479f29ba8c85, UNASSIGN 2023-07-12 22:15:15,874 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56c62cc97eb62dd2ae078c1f496b08a6, UNASSIGN 2023-07-12 22:15:15,875 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=78995bea505176a09d56479f29ba8c85, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:15,875 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=56c62cc97eb62dd2ae078c1f496b08a6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:15,875 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200115875"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200115875"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200115875"}]},"ts":"1689200115875"} 2023-07-12 22:15:15,875 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200115875"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200115875"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200115875"}]},"ts":"1689200115875"} 2023-07-12 22:15:15,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 78995bea505176a09d56479f29ba8c85, server=jenkins-hbase4.apache.org,34131,1689200016023}] 2023-07-12 22:15:15,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 56c62cc97eb62dd2ae078c1f496b08a6, server=jenkins-hbase4.apache.org,45649,1689200015893}] 2023-07-12 22:15:15,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 22:15:16,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 78995bea505176a09d56479f29ba8c85 2023-07-12 22:15:16,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 78995bea505176a09d56479f29ba8c85, disabling compactions & flushes 2023-07-12 22:15:16,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:15:16,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:15:16,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. after waiting 0 ms 2023-07-12 22:15:16,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:15:16,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:15:16,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 56c62cc97eb62dd2ae078c1f496b08a6, disabling compactions & flushes 2023-07-12 22:15:16,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:15:16,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:15:16,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. after waiting 0 ms 2023-07-12 22:15:16,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:15:16,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:16,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:16,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6. 2023-07-12 22:15:16,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 56c62cc97eb62dd2ae078c1f496b08a6: 2023-07-12 22:15:16,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:15:16,067 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=56c62cc97eb62dd2ae078c1f496b08a6, regionState=CLOSED 2023-07-12 22:15:16,067 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200116067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200116067"}]},"ts":"1689200116067"} 2023-07-12 22:15:16,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-12 22:15:16,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 56c62cc97eb62dd2ae078c1f496b08a6, server=jenkins-hbase4.apache.org,45649,1689200015893 in 191 msec 2023-07-12 22:15:16,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56c62cc97eb62dd2ae078c1f496b08a6, UNASSIGN in 201 msec 2023-07-12 22:15:16,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:16,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:16,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85. 2023-07-12 22:15:16,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 78995bea505176a09d56479f29ba8c85: 2023-07-12 22:15:16,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 78995bea505176a09d56479f29ba8c85 2023-07-12 22:15:16,080 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=78995bea505176a09d56479f29ba8c85, regionState=CLOSED 2023-07-12 22:15:16,080 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689200116080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200116080"}]},"ts":"1689200116080"} 2023-07-12 22:15:16,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-12 22:15:16,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 78995bea505176a09d56479f29ba8c85, server=jenkins-hbase4.apache.org,34131,1689200016023 in 205 msec 2023-07-12 22:15:16,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-12 22:15:16,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=78995bea505176a09d56479f29ba8c85, UNASSIGN in 214 msec 2023-07-12 22:15:16,092 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200116092"}]},"ts":"1689200116092"} 2023-07-12 22:15:16,094 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 22:15:16,102 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 22:15:16,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 243 msec 2023-07-12 22:15:16,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 22:15:16,169 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 22:15:16,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,175 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,176 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,179 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,179 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,179 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,179 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 22:15:16,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 22:15:16,180 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:15:16,180 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85 2023-07-12 22:15:16,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 22:15:16,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 22:15:16,182 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,182 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:16,182 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,182 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:16,182 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,182 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:16,183 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,183 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:16,183 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/recovered.edits] 2023-07-12 22:15:16,183 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/recovered.edits] 2023-07-12 22:15:16,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 22:15:16,196 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/cf/644edc008d3040739a1f0da5f20d8ab0 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/cf/644edc008d3040739a1f0da5f20d8ab0 2023-07-12 22:15:16,196 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/cf/a9bc364cbd2c406a888db9d333cf6c3a to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/cf/a9bc364cbd2c406a888db9d333cf6c3a 2023-07-12 22:15:16,207 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6/recovered.edits/9.seqid 2023-07-12 22:15:16,207 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56c62cc97eb62dd2ae078c1f496b08a6 2023-07-12 22:15:16,208 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85/recovered.edits/9.seqid 2023-07-12 22:15:16,209 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/78995bea505176a09d56479f29ba8c85 2023-07-12 22:15:16,209 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 22:15:16,212 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,218 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 22:15:16,221 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 22:15:16,229 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,229 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 22:15:16,229 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200116229"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:16,229 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200116229"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:16,231 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:15:16,231 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 78995bea505176a09d56479f29ba8c85, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689200092962.78995bea505176a09d56479f29ba8c85.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 56c62cc97eb62dd2ae078c1f496b08a6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689200092962.56c62cc97eb62dd2ae078c1f496b08a6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:15:16,231 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 22:15:16,231 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200116231"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:16,233 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 22:15:16,237 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 67 msec 2023-07-12 22:15:16,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 22:15:16,285 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 22:15:16,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 22:15:16,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 22:15:16,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 22:15:16,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 22:15:16,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 22:15:16,355 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 746) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:34172 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1717740785) connection to jenkins-hbase4.apache.org/172.31.14.131:35739 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1917625443_1 at /127.0.0.1:37606 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:38668 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1717740785) connection to jenkins-hbase4.apache.org/172.31.14.131:38439 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1917625443_1 at /127.0.0.1:38652 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4066 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:37628 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=728 (was 505) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=4353 (was 5238) 2023-07-12 22:15:16,355 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 22:15:16,386 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=728, ProcessCount=179, AvailableMemoryMB=4351 2023-07-12 22:15:16,386 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 22:15:16,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:15:16,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:16,401 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:15:16,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 22:15:16,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 22:15:16,407 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:15:16,411 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:16,411 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:16,412 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95 empty. 2023-07-12 22:15:16,412 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525 empty. 2023-07-12 22:15:16,412 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:16,412 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:16,412 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 22:15:16,439 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 22:15:16,441 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3abeedf056dcd59c8ec1b4dfd3228525, NAME => 'testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:15:16,441 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c0bd20838a79365f53700ea451589f95, NAME => 'testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:15:16,480 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:16,480 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 3abeedf056dcd59c8ec1b4dfd3228525, disabling compactions & flushes 2023-07-12 22:15:16,480 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:16,480 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:16,480 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. after waiting 0 ms 2023-07-12 22:15:16,480 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:16,480 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:16,480 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 3abeedf056dcd59c8ec1b4dfd3228525: 2023-07-12 22:15:16,481 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:16,481 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c0bd20838a79365f53700ea451589f95, disabling compactions & flushes 2023-07-12 22:15:16,481 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:16,481 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:16,481 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. after waiting 0 ms 2023-07-12 22:15:16,481 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:16,481 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:16,481 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c0bd20838a79365f53700ea451589f95: 2023-07-12 22:15:16,486 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:15:16,487 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200116487"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200116487"}]},"ts":"1689200116487"} 2023-07-12 22:15:16,488 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200116487"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200116487"}]},"ts":"1689200116487"} 2023-07-12 22:15:16,490 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:15:16,490 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:15:16,491 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200116490"}]},"ts":"1689200116490"} 2023-07-12 22:15:16,495 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 22:15:16,498 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:15:16,500 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:15:16,500 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:15:16,500 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:15:16,500 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:15:16,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c0bd20838a79365f53700ea451589f95, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3abeedf056dcd59c8ec1b4dfd3228525, ASSIGN}] 2023-07-12 22:15:16,504 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3abeedf056dcd59c8ec1b4dfd3228525, ASSIGN 2023-07-12 22:15:16,504 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c0bd20838a79365f53700ea451589f95, ASSIGN 2023-07-12 22:15:16,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 22:15:16,511 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c0bd20838a79365f53700ea451589f95, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34577,1689200015954; forceNewPlan=false, retain=false 2023-07-12 22:15:16,511 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3abeedf056dcd59c8ec1b4dfd3228525, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34131,1689200016023; forceNewPlan=false, retain=false 2023-07-12 22:15:16,661 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:15:16,664 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c0bd20838a79365f53700ea451589f95, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:16,664 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=3abeedf056dcd59c8ec1b4dfd3228525, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:16,665 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200116664"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200116664"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200116664"}]},"ts":"1689200116664"} 2023-07-12 22:15:16,665 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200116664"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200116664"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200116664"}]},"ts":"1689200116664"} 2023-07-12 22:15:16,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 3abeedf056dcd59c8ec1b4dfd3228525, server=jenkins-hbase4.apache.org,34131,1689200016023}] 2023-07-12 22:15:16,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure c0bd20838a79365f53700ea451589f95, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:15:16,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 22:15:16,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:16,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:16,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c0bd20838a79365f53700ea451589f95, NAME => 'testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:15:16,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3abeedf056dcd59c8ec1b4dfd3228525, NAME => 'testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:15:16,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. service=AccessControlService 2023-07-12 22:15:16,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:15:16,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:16,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:16,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:16,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:16,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. service=AccessControlService 2023-07-12 22:15:16,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:15:16,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:16,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:16,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:16,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:16,828 INFO [StoreOpener-c0bd20838a79365f53700ea451589f95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:16,828 INFO [StoreOpener-3abeedf056dcd59c8ec1b4dfd3228525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:16,830 DEBUG [StoreOpener-3abeedf056dcd59c8ec1b4dfd3228525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/cf 2023-07-12 22:15:16,830 DEBUG [StoreOpener-c0bd20838a79365f53700ea451589f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/cf 2023-07-12 22:15:16,830 DEBUG [StoreOpener-3abeedf056dcd59c8ec1b4dfd3228525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/cf 2023-07-12 22:15:16,830 DEBUG [StoreOpener-c0bd20838a79365f53700ea451589f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/cf 2023-07-12 22:15:16,830 INFO [StoreOpener-c0bd20838a79365f53700ea451589f95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0bd20838a79365f53700ea451589f95 columnFamilyName cf 2023-07-12 22:15:16,830 INFO [StoreOpener-3abeedf056dcd59c8ec1b4dfd3228525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3abeedf056dcd59c8ec1b4dfd3228525 columnFamilyName cf 2023-07-12 22:15:16,831 INFO [StoreOpener-c0bd20838a79365f53700ea451589f95-1] regionserver.HStore(310): Store=c0bd20838a79365f53700ea451589f95/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:15:16,831 INFO [StoreOpener-3abeedf056dcd59c8ec1b4dfd3228525-1] regionserver.HStore(310): Store=3abeedf056dcd59c8ec1b4dfd3228525/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:15:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:16,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:16,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:16,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:15:16,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c0bd20838a79365f53700ea451589f95; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73974387, jitterRate=0.10230426490306854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:15:16,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c0bd20838a79365f53700ea451589f95: 2023-07-12 22:15:16,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95., pid=94, masterSystemTime=1689200116819 2023-07-12 22:15:16,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:16,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:15:16,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:16,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3abeedf056dcd59c8ec1b4dfd3228525; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62558644, jitterRate=-0.06780356168746948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:15:16,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3abeedf056dcd59c8ec1b4dfd3228525: 2023-07-12 22:15:16,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525., pid=93, masterSystemTime=1689200116819 2023-07-12 22:15:16,845 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c0bd20838a79365f53700ea451589f95, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:16,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:16,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:16,846 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200116845"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200116845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200116845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200116845"}]},"ts":"1689200116845"} 2023-07-12 22:15:16,846 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=3abeedf056dcd59c8ec1b4dfd3228525, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:16,846 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200116846"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200116846"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200116846"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200116846"}]},"ts":"1689200116846"} 2023-07-12 22:15:16,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-12 22:15:16,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure c0bd20838a79365f53700ea451589f95, server=jenkins-hbase4.apache.org,34577,1689200015954 in 180 msec 2023-07-12 22:15:16,850 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-12 22:15:16,850 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 3abeedf056dcd59c8ec1b4dfd3228525, server=jenkins-hbase4.apache.org,34131,1689200016023 in 181 msec 2023-07-12 22:15:16,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c0bd20838a79365f53700ea451589f95, ASSIGN in 349 msec 2023-07-12 22:15:16,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-12 22:15:16,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3abeedf056dcd59c8ec1b4dfd3228525, ASSIGN in 350 msec 2023-07-12 22:15:16,852 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:15:16,852 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200116852"}]},"ts":"1689200116852"} 2023-07-12 22:15:16,853 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 22:15:16,926 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:15:16,927 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 22:15:16,928 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:15:16,986 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:16,986 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:16,986 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:16,986 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:17,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 22:15:17,041 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:17,041 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:17,042 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:17,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:17,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 651 msec 2023-07-12 22:15:17,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 22:15:17,509 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 22:15:17,509 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 22:15:17,510 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:17,517 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 22:15:17,517 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:17,517 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-12 22:15:17,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:17,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200117520 (current time:1689200117520). 2023-07-12 22:15:17,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:15:17,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x77d0b94b to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:17,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a2f1db0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:17,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:17,539 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:17,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77d0b94b to 127.0.0.1:50879 2023-07-12 22:15:17,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:17,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x6c61ee3f to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:17,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e891819, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:17,552 DEBUG [hconnection-0x3ce954e5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:17,553 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:17,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c61ee3f to 127.0.0.1:50879 2023-07-12 22:15:17,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:17,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:15:17,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:15:17,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:17,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:17,564 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:17,565 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689200717565 2023-07-12 22:15:17,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:17,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:17,566 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:15:17,567 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:15:17,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:17,568 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:17,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-12 22:15:17,573 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:17,575 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689200717575 2023-07-12 22:15:17,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,597 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 22:15:17,597 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:17,599 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 22:15:17,599 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 22:15:17,663 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,663 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,667 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:17,667 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,667 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,667 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,667 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:17,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,669 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:15:17,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 22:15:17,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:17,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 22:15:17,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:17,670 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:17,670 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:17,672 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:17,672 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:17,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,673 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,674 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:15:17,673 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:17,673 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:17,674 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:17,674 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 22:15:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,683 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:17,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,684 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:17,684 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:17,685 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,686 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,686 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,686 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:17,686 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:17,687 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,687 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,687 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,687 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:17,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 22:15:17,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7feeeedc[Count = 1] remaining members to acquire global barrier 2023-07-12 22:15:17,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 22:15:17,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7feeeedc[Count = 0] remaining members to acquire global barrier 2023-07-12 22:15:17,692 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 22:15:17,692 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:15:17,694 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,695 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:17,695 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:17,695 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:17,695 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. started... 2023-07-12 22:15:17,695 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,695 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:15:17,696 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:17,696 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:17,696 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:17,700 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:17,700 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:17,700 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:17,700 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3abeedf056dcd59c8ec1b4dfd3228525: 2023-07-12 22:15:17,700 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. started... 2023-07-12 22:15:17,702 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c0bd20838a79365f53700ea451589f95: 2023-07-12 22:15:17,702 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,702 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:17,702 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:15:17,702 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,702 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:17,702 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:15:17,743 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. completed. 2023-07-12 22:15:17,743 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. completed. 2023-07-12 22:15:17,743 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:17,743 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:15:17,743 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:15:17,746 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,746 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:17,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,746 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:17,747 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:17,748 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:17,748 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,748 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:17,748 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:17,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34131,1689200016023': 2023-07-12 22:15:17,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 22:15:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:15:17,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 22:15:17,760 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 22:15:17,760 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:15:17,760 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:15:17,760 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,760 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:15:17,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,762 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,774 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,776 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,776 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,782 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,782 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,783 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,786 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,786 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,787 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,787 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,787 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,787 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,787 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:17,786 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,787 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:17,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,787 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,789 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,789 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,789 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,789 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,790 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,790 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,790 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,790 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:17,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:17,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,850 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 22:15:17,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,850 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689200117565Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689200117789 (+224 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689200117789Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689200117798 (+9 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689200117815 (+17 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689200117850 (+35 ms) 2023-07-12 22:15:17,853 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:17,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 287 msec 2023-07-12 22:15:17,869 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:17,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:17,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:15:17,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34577] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:15:17,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:15:17,882 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:17,882 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:17,882 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:17,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:17,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200117897 (current time:1689200117897). 2023-07-12 22:15:17,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:15:17,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x16bdccd6 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:17,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6085fc98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:17,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:17,910 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:17,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16bdccd6 to 127.0.0.1:50879 2023-07-12 22:15:17,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:17,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x1b9f12e1 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:17,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63bca638, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:17,922 DEBUG [hconnection-0x2c92f7eb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:17,926 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:17,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b9f12e1 to 127.0.0.1:50879 2023-07-12 22:15:17,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:17,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 22:15:17,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:15:17,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:17,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:17,936 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:17,937 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689200717937 2023-07-12 22:15:17,937 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:17,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 22:15:17,939 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:15:17,939 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:15:17,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:17,940 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 22:15:17,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 22:15:17,941 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:17,943 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689200717943 2023-07-12 22:15:17,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,957 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 22:15:17,957 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:17,959 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 22:15:17,959 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 22:15:17,959 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,959 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,962 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,962 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,962 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,962 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,962 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,962 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,962 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,963 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:17,964 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:17,964 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,964 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,964 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:17,964 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:17,964 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 22:15:17,966 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:17,964 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:17,966 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:17,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,967 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:17,967 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:17,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 22:15:17,966 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:17,967 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:17,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 22:15:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:17,971 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 22:15:17,971 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 22:15:17,971 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 22:15:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,973 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,973 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:17,974 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,974 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,974 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,974 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 22:15:17,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f58506f[Count = 1] remaining members to acquire global barrier 2023-07-12 22:15:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:17,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 22:15:17,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f58506f[Count = 0] remaining members to acquire global barrier 2023-07-12 22:15:17,985 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 22:15:17,985 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,991 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,991 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,991 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,991 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:17,991 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:17,991 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:17,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,991 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:15:17,991 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:17,992 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 22:15:17,992 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:17,992 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:15:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:17,992 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. started... 2023-07-12 22:15:17,992 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:17,992 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. started... 2023-07-12 22:15:17,993 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3abeedf056dcd59c8ec1b4dfd3228525 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-12 22:15:17,993 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c0bd20838a79365f53700ea451589f95 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-12 22:15:17,993 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:17,993 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:17,993 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:18,025 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/.tmp/cf/0db65320048f4847aa4570aedf3a0699 2023-07-12 22:15:18,027 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/.tmp/cf/698fc94b537c4381b8caf465bc5f25e1 2023-07-12 22:15:18,035 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/.tmp/cf/698fc94b537c4381b8caf465bc5f25e1 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/cf/698fc94b537c4381b8caf465bc5f25e1 2023-07-12 22:15:18,037 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/.tmp/cf/0db65320048f4847aa4570aedf3a0699 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/cf/0db65320048f4847aa4570aedf3a0699 2023-07-12 22:15:18,039 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:18,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:18,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:18,041 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:15:18,042 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/cf/698fc94b537c4381b8caf465bc5f25e1, entries=7, sequenceid=6, filesize=5.3 K 2023-07-12 22:15:18,045 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for c0bd20838a79365f53700ea451589f95 in 51ms, sequenceid=6, compaction requested=false 2023-07-12 22:15:18,045 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 22:15:18,045 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c0bd20838a79365f53700ea451589f95: 2023-07-12 22:15:18,045 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,059 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:18,059 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/cf/698fc94b537c4381b8caf465bc5f25e1] hfiles 2023-07-12 22:15:18,059 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/cf/698fc94b537c4381b8caf465bc5f25e1 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,060 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/cf/0db65320048f4847aa4570aedf3a0699, entries=43, sequenceid=6, filesize=7.7 K 2023-07-12 22:15:18,063 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 3abeedf056dcd59c8ec1b4dfd3228525 in 71ms, sequenceid=6, compaction requested=false 2023-07-12 22:15:18,065 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3abeedf056dcd59c8ec1b4dfd3228525: 2023-07-12 22:15:18,065 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,065 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:18,065 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/cf/0db65320048f4847aa4570aedf3a0699] hfiles 2023-07-12 22:15:18,065 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/cf/0db65320048f4847aa4570aedf3a0699 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,102 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. completed. 2023-07-12 22:15:18,102 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,102 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. completed. 2023-07-12 22:15:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:15:18,102 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 22:15:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:15:18,105 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,105 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:18,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:18,107 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 22:15:18,107 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:18,107 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 22:15:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:15:18,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 22:15:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34131,1689200016023': 2023-07-12 22:15:18,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 22:15:18,117 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 22:15:18,118 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:15:18,118 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:15:18,118 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,118 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:15:18,120 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:18,120 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:18,120 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:18,120 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:18,121 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:18,121 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:18,126 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,126 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,126 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,134 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:18,134 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:18,134 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:18,135 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:18,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:18,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:18,135 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,135 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:18,135 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:18,135 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:18,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:18,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:18,135 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:18,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:18,135 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:18,137 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:18,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:18,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:18,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:18,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:18,137 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,137 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:18,137 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,137 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:18,137 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:18,137 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,137 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,241 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:18,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:18,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:18,242 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:15:18,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 22:15:18,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,247 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689200117937Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689200118136 (+199 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689200118137 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689200118147 (+10 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689200118177 (+30 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689200118246 (+69 ms) 2023-07-12 22:15:18,250 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 22:15:18,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 312 msec 2023-07-12 22:15:18,543 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:18,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 22:15:18,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:15:18,544 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544 2023-07-12 22:15:18,544 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34859, tgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544, rawTgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544, srcFsUri=hdfs://localhost:34859, srcDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:15:18,569 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:15:18,569 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1138954478_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,569 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3, snapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 22:15:18,585 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:18,660 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,661 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,662 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,662 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,663 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,663 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,663 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,770 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop-3914851956329122255.jar 2023-07-12 22:15:18,771 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,771 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,771 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,772 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,772 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,772 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:18,773 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:15:18,773 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:15:18,773 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:15:18,774 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:15:18,774 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:15:18,775 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:15:18,775 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:15:18,775 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:15:18,776 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:15:18,776 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:15:18,776 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:18,777 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:18,777 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:18,777 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:18,778 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:18,778 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:18,779 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:19,757 WARN [Listener at jenkins-hbase4.apache.org/46373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:15:19,761 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 22:15:20,006 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:20,006 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:20,011 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0005_000001 (auth:SIMPLE) 2023-07-12 22:15:20,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0006_000001 (auth:SIMPLE) 2023-07-12 22:15:21,229 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:15:26,519 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0006_000001 (auth:SIMPLE) 2023-07-12 22:15:30,202 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:15:30,205 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:15:30,210 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:30,210 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:15:30,211 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:15:30,211 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:30,212 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 22:15:30,212 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 22:15:30,212 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:30,212 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 22:15:30,212 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200118544/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 22:15:30,218 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 22:15:30,223 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200130222"}]},"ts":"1689200130222"} 2023-07-12 22:15:30,224 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 22:15:30,226 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 22:15:30,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c0bd20838a79365f53700ea451589f95, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3abeedf056dcd59c8ec1b4dfd3228525, UNASSIGN}] 2023-07-12 22:15:30,229 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c0bd20838a79365f53700ea451589f95, UNASSIGN 2023-07-12 22:15:30,229 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3abeedf056dcd59c8ec1b4dfd3228525, UNASSIGN 2023-07-12 22:15:30,230 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c0bd20838a79365f53700ea451589f95, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:30,230 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=3abeedf056dcd59c8ec1b4dfd3228525, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:30,230 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200130229"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200130229"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200130229"}]},"ts":"1689200130229"} 2023-07-12 22:15:30,230 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200130230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200130230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200130230"}]},"ts":"1689200130230"} 2023-07-12 22:15:30,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure c0bd20838a79365f53700ea451589f95, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:15:30,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 3abeedf056dcd59c8ec1b4dfd3228525, server=jenkins-hbase4.apache.org,34131,1689200016023}] 2023-07-12 22:15:30,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 22:15:30,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:30,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c0bd20838a79365f53700ea451589f95, disabling compactions & flushes 2023-07-12 22:15:30,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:30,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:30,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. after waiting 0 ms 2023-07-12 22:15:30,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:30,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:30,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3abeedf056dcd59c8ec1b4dfd3228525, disabling compactions & flushes 2023-07-12 22:15:30,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:30,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:30,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. after waiting 0 ms 2023-07-12 22:15:30,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:30,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:30,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:30,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95. 2023-07-12 22:15:30,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c0bd20838a79365f53700ea451589f95: 2023-07-12 22:15:30,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:30,479 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c0bd20838a79365f53700ea451589f95, regionState=CLOSED 2023-07-12 22:15:30,479 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200130478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200130478"}]},"ts":"1689200130478"} 2023-07-12 22:15:30,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-12 22:15:30,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure c0bd20838a79365f53700ea451589f95, server=jenkins-hbase4.apache.org,34577,1689200015954 in 250 msec 2023-07-12 22:15:30,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c0bd20838a79365f53700ea451589f95, UNASSIGN in 257 msec 2023-07-12 22:15:30,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:30,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:30,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525. 2023-07-12 22:15:30,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3abeedf056dcd59c8ec1b4dfd3228525: 2023-07-12 22:15:30,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:30,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=3abeedf056dcd59c8ec1b4dfd3228525, regionState=CLOSED 2023-07-12 22:15:30,493 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689200130493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200130493"}]},"ts":"1689200130493"} 2023-07-12 22:15:30,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-12 22:15:30,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 3abeedf056dcd59c8ec1b4dfd3228525, server=jenkins-hbase4.apache.org,34131,1689200016023 in 263 msec 2023-07-12 22:15:30,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-12 22:15:30,500 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3abeedf056dcd59c8ec1b4dfd3228525, UNASSIGN in 271 msec 2023-07-12 22:15:30,500 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200130500"}]},"ts":"1689200130500"} 2023-07-12 22:15:30,502 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 22:15:30,504 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 22:15:30,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 286 msec 2023-07-12 22:15:30,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 22:15:30,526 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 22:15:30,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,537 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,537 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,540 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,543 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,543 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,543 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,543 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 22:15:30,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 22:15:30,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 22:15:30,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 22:15:30,545 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:30,545 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:30,546 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,546 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,546 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,546 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,547 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,547 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,547 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,547 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:30,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 22:15:30,555 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/recovered.edits] 2023-07-12 22:15:30,562 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/recovered.edits] 2023-07-12 22:15:30,572 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/cf/0db65320048f4847aa4570aedf3a0699 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/cf/0db65320048f4847aa4570aedf3a0699 2023-07-12 22:15:30,574 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/cf/698fc94b537c4381b8caf465bc5f25e1 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/cf/698fc94b537c4381b8caf465bc5f25e1 2023-07-12 22:15:30,578 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525/recovered.edits/9.seqid 2023-07-12 22:15:30,578 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/3abeedf056dcd59c8ec1b4dfd3228525 2023-07-12 22:15:30,582 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95/recovered.edits/9.seqid 2023-07-12 22:15:30,582 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testEmptyExportFileSystemState/c0bd20838a79365f53700ea451589f95 2023-07-12 22:15:30,583 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 22:15:30,586 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,600 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 22:15:30,609 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 22:15:30,611 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,611 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 22:15:30,611 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200130611"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:30,611 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200130611"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:30,627 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:15:30,627 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c0bd20838a79365f53700ea451589f95, NAME => 'testtb-testEmptyExportFileSystemState,,1689200116389.c0bd20838a79365f53700ea451589f95.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3abeedf056dcd59c8ec1b4dfd3228525, NAME => 'testtb-testEmptyExportFileSystemState,1,1689200116389.3abeedf056dcd59c8ec1b4dfd3228525.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:15:30,627 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 22:15:30,628 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200130627"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:30,641 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 22:15:30,644 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 22:15:30,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 117 msec 2023-07-12 22:15:30,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 22:15:30,650 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 22:15:30,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 22:15:30,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:30,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 22:15:30,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 22:15:30,742 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 762), OpenFileDescriptor=905 (was 911), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=786 (was 728) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=3224 (was 4351) 2023-07-12 22:15:30,742 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-12 22:15:30,793 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=786, ProcessCount=181, AvailableMemoryMB=3222 2023-07-12 22:15:30,793 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-12 22:15:30,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 22:15:30,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:30,801 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 22:15:30,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 22:15:30,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 22:15:30,804 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 22:15:30,806 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:30,806 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:30,807 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2 empty. 2023-07-12 22:15:30,807 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f empty. 2023-07-12 22:15:30,807 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:30,807 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:30,808 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 22:15:30,865 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 22:15:30,866 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7bb6b0dcee0dc6f32e85400b6329415f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:15:30,887 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => a0fc0bf9f736d9c574e5cd1876415ba2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp 2023-07-12 22:15:30,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 22:15:30,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:30,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 7bb6b0dcee0dc6f32e85400b6329415f, disabling compactions & flushes 2023-07-12 22:15:30,953 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:30,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:30,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. after waiting 0 ms 2023-07-12 22:15:30,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:30,953 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:30,953 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 7bb6b0dcee0dc6f32e85400b6329415f: 2023-07-12 22:15:30,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:30,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing a0fc0bf9f736d9c574e5cd1876415ba2, disabling compactions & flushes 2023-07-12 22:15:30,968 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:30,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:30,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. after waiting 0 ms 2023-07-12 22:15:30,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:30,968 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:30,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for a0fc0bf9f736d9c574e5cd1876415ba2: 2023-07-12 22:15:30,971 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 22:15:30,972 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200130972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200130972"}]},"ts":"1689200130972"} 2023-07-12 22:15:30,973 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200130972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200130972"}]},"ts":"1689200130972"} 2023-07-12 22:15:30,976 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 22:15:30,977 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 22:15:30,978 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200130978"}]},"ts":"1689200130978"} 2023-07-12 22:15:30,979 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 22:15:30,984 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 22:15:30,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 22:15:30,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 22:15:30,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 22:15:30,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 22:15:30,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7bb6b0dcee0dc6f32e85400b6329415f, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0fc0bf9f736d9c574e5cd1876415ba2, ASSIGN}] 2023-07-12 22:15:30,991 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0fc0bf9f736d9c574e5cd1876415ba2, ASSIGN 2023-07-12 22:15:30,992 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7bb6b0dcee0dc6f32e85400b6329415f, ASSIGN 2023-07-12 22:15:30,993 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0fc0bf9f736d9c574e5cd1876415ba2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34577,1689200015954; forceNewPlan=false, retain=false 2023-07-12 22:15:30,993 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7bb6b0dcee0dc6f32e85400b6329415f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34131,1689200016023; forceNewPlan=false, retain=false 2023-07-12 22:15:31,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 22:15:31,143 INFO [jenkins-hbase4:38945] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 22:15:31,148 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a0fc0bf9f736d9c574e5cd1876415ba2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,148 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200131148"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200131148"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200131148"}]},"ts":"1689200131148"} 2023-07-12 22:15:31,148 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7bb6b0dcee0dc6f32e85400b6329415f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,149 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200131148"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200131148"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200131148"}]},"ts":"1689200131148"} 2023-07-12 22:15:31,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure a0fc0bf9f736d9c574e5cd1876415ba2, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:15:31,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 7bb6b0dcee0dc6f32e85400b6329415f, server=jenkins-hbase4.apache.org,34131,1689200016023}] 2023-07-12 22:15:31,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:31,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0fc0bf9f736d9c574e5cd1876415ba2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 22:15:31,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. service=AccessControlService 2023-07-12 22:15:31,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:31,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7bb6b0dcee0dc6f32e85400b6329415f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 22:15:31,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. service=AccessControlService 2023-07-12 22:15:31,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:15:31,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:31,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 22:15:31,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:31,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:31,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:31,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:31,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 22:15:31,317 INFO [StoreOpener-7bb6b0dcee0dc6f32e85400b6329415f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:31,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:31,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:31,322 INFO [StoreOpener-a0fc0bf9f736d9c574e5cd1876415ba2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:31,323 DEBUG [StoreOpener-7bb6b0dcee0dc6f32e85400b6329415f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/cf 2023-07-12 22:15:31,323 DEBUG [StoreOpener-7bb6b0dcee0dc6f32e85400b6329415f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/cf 2023-07-12 22:15:31,324 INFO [StoreOpener-7bb6b0dcee0dc6f32e85400b6329415f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7bb6b0dcee0dc6f32e85400b6329415f columnFamilyName cf 2023-07-12 22:15:31,324 DEBUG [StoreOpener-a0fc0bf9f736d9c574e5cd1876415ba2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/cf 2023-07-12 22:15:31,324 DEBUG [StoreOpener-a0fc0bf9f736d9c574e5cd1876415ba2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/cf 2023-07-12 22:15:31,325 INFO [StoreOpener-7bb6b0dcee0dc6f32e85400b6329415f-1] regionserver.HStore(310): Store=7bb6b0dcee0dc6f32e85400b6329415f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:15:31,325 INFO [StoreOpener-a0fc0bf9f736d9c574e5cd1876415ba2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0fc0bf9f736d9c574e5cd1876415ba2 columnFamilyName cf 2023-07-12 22:15:31,326 INFO [StoreOpener-a0fc0bf9f736d9c574e5cd1876415ba2-1] regionserver.HStore(310): Store=a0fc0bf9f736d9c574e5cd1876415ba2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 22:15:31,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:31,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:31,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:31,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:31,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:31,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:31,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:15:31,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a0fc0bf9f736d9c574e5cd1876415ba2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61904886, jitterRate=-0.07754531502723694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:15:31,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a0fc0bf9f736d9c574e5cd1876415ba2: 2023-07-12 22:15:31,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2., pid=108, masterSystemTime=1689200131307 2023-07-12 22:15:31,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:31,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:31,344 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a0fc0bf9f736d9c574e5cd1876415ba2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,344 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200131344"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200131344"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200131344"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200131344"}]},"ts":"1689200131344"} 2023-07-12 22:15:31,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-12 22:15:31,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure a0fc0bf9f736d9c574e5cd1876415ba2, server=jenkins-hbase4.apache.org,34577,1689200015954 in 192 msec 2023-07-12 22:15:31,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 22:15:31,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7bb6b0dcee0dc6f32e85400b6329415f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60570278, jitterRate=-0.09743252396583557}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 22:15:31,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7bb6b0dcee0dc6f32e85400b6329415f: 2023-07-12 22:15:31,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f., pid=109, masterSystemTime=1689200131311 2023-07-12 22:15:31,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0fc0bf9f736d9c574e5cd1876415ba2, ASSIGN in 364 msec 2023-07-12 22:15:31,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:31,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:31,358 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7bb6b0dcee0dc6f32e85400b6329415f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,358 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200131358"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689200131358"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689200131358"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689200131358"}]},"ts":"1689200131358"} 2023-07-12 22:15:31,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-12 22:15:31,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 7bb6b0dcee0dc6f32e85400b6329415f, server=jenkins-hbase4.apache.org,34131,1689200016023 in 204 msec 2023-07-12 22:15:31,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-12 22:15:31,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7bb6b0dcee0dc6f32e85400b6329415f, ASSIGN in 376 msec 2023-07-12 22:15:31,364 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 22:15:31,364 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200131364"}]},"ts":"1689200131364"} 2023-07-12 22:15:31,366 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 22:15:31,368 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 22:15:31,368 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 22:15:31,370 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 22:15:31,372 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:31,372 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:31,372 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:31,372 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:31,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:31,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:31,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:31,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 22:15:31,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 578 msec 2023-07-12 22:15:31,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 22:15:31,408 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 22:15:31,408 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-12 22:15:31,408 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:31,412 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-12 22:15:31,412 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:31,412 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-12 22:15:31,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200131418 (current time:1689200131418). 2023-07-12 22:15:31,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:15:31,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x38a6e152 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:31,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40e5cbc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:31,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,446 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38a6e152 to 127.0.0.1:50879 2023-07-12 22:15:31,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:31,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x2d42ec02 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:31,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22e12489, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:31,499 DEBUG [hconnection-0x4c3470e8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,504 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d42ec02 to 127.0.0.1:50879 2023-07-12 22:15:31,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:31,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 22:15:31,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:15:31,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,524 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,526 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689200731526 2023-07-12 22:15:31,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,526 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,528 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:15:31,528 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:15:31,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,530 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-12 22:15:31,535 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,537 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689200731537 2023-07-12 22:15:31,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,602 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 22:15:31,602 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,604 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 22:15:31,604 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 22:15:31,605 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,605 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,609 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,609 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,610 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,610 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,610 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,610 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,610 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,610 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:15:31,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 22:15:31,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 22:15:31,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,612 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,612 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 22:15:31,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,613 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,615 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,615 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,620 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,620 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,620 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,621 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,621 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,624 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,623 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,624 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,624 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,629 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:31,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:31,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:31,630 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:15:31,631 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,631 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,633 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,634 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,635 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,635 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,635 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 22:15:31,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28e42815[Count = 1] remaining members to acquire global barrier 2023-07-12 22:15:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 22:15:31,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28e42815[Count = 0] remaining members to acquire global barrier 2023-07-12 22:15:31,639 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 22:15:31,640 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,641 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,641 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,641 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,641 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:15:31,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,642 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:31,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,642 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,642 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. started... 2023-07-12 22:15:31,642 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,645 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:31,645 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7bb6b0dcee0dc6f32e85400b6329415f: 2023-07-12 22:15:31,645 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:31,645 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,645 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,645 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:31,645 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,646 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:31,645 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:15:31,647 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:31,645 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:31,647 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. started... 2023-07-12 22:15:31,647 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:15:31,649 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0fc0bf9f736d9c574e5cd1876415ba2: 2023-07-12 22:15:31,649 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,649 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:31,649 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 22:15:31,674 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. completed. 2023-07-12 22:15:31,674 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:31,674 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:31,674 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:31,674 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,674 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:31,674 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:15:31,675 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. completed. 2023-07-12 22:15:31,675 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:31,675 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:31,675 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:31,675 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,675 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:31,675 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:15:31,676 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:31,676 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,676 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:31,680 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,680 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,680 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:31,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,680 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,680 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:31,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34131,1689200016023': 2023-07-12 22:15:31,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 22:15:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:15:31,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 22:15:31,690 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 22:15:31,690 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:15:31,690 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:15:31,690 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,690 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:15:31,695 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,695 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,695 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,695 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,695 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,695 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,695 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,696 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,696 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,700 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,702 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,702 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,703 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,707 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,707 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,707 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,707 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,707 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,707 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,707 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:31,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,708 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,707 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,710 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:31,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:31,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 22:15:31,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,816 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689200131526Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689200131710 (+184 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689200131710Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689200131720 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689200131756 (+36 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689200131815 (+59 ms) 2023-07-12 22:15:31,820 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 292 msec 2023-07-12 22:15:31,830 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:31,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:31,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:15:31,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34131] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:15:31,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 22:15:31,849 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,849 DEBUG [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:31,849 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 22:15:31,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689200131868 (current time:1689200131868). 2023-07-12 22:15:31,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 22:15:31,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x248f1172 to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:31,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b53863b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:31,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,880 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x248f1172 to 127.0.0.1:50879 2023-07-12 22:15:31,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:31,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(139): Connect 0x37f513fb to 127.0.0.1:50879 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 22:15:31,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b2d80f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 22:15:31,890 DEBUG [hconnection-0x3c18b1f6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 22:15:31,891 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 22:15:31,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37f513fb to 127.0.0.1:50879 2023-07-12 22:15:31,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:15:31,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 22:15:31,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 22:15:31,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,903 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,904 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689200731904 2023-07-12 22:15:31,904 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 22:15:31,906 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 22:15:31,906 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 22:15:31,908 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 22:15:31,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-12 22:15:31,910 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:31,911 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689200731911 2023-07-12 22:15:31,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,934 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 22:15:31,934 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,936 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 22:15:31,936 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 22:15:31,937 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,937 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,939 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,939 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,940 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:31,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:31,940 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:31,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 22:15:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,941 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 22:15:31,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,941 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,941 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,942 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 22:15:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,942 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 22:15:31,942 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,942 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 22:15:31,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,942 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,943 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,943 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,943 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 22:15:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45649,1689200015893' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,950 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 22:15:31,952 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 22:15:31,952 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 22:15:31,952 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 22:15:31,955 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,955 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,955 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,955 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,955 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,955 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,956 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,956 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,956 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,963 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,963 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 22:15:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34577,1689200015954' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 22:15:31,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39873ae[Count = 1] remaining members to acquire global barrier 2023-07-12 22:15:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:31,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:31,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:31,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34131,1689200016023' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 22:15:31,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39873ae[Count = 0] remaining members to acquire global barrier 2023-07-12 22:15:31,972 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 22:15:31,972 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,978 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,978 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,979 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,979 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,979 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:31,979 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45649,1689200015893' in zk 2023-07-12 22:15:31,979 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:31,979 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:31,979 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:31,979 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. started... 2023-07-12 22:15:31,979 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7bb6b0dcee0dc6f32e85400b6329415f 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 22:15:31,979 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:31,980 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 22:15:31,980 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 22:15:31,980 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 22:15:31,980 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:31,980 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. started... 2023-07-12 22:15:31,980 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a0fc0bf9f736d9c574e5cd1876415ba2 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 22:15:31,980 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:31,980 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:31,981 DEBUG [member: 'jenkins-hbase4.apache.org,45649,1689200015893' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:31,983 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:31,983 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:31,983 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 22:15:32,006 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:32,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:32,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:32,008 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 22:15:32,099 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/.tmp/cf/5db1372816cd4838a47d4a029569e9b1 2023-07-12 22:15:32,099 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/.tmp/cf/3c65a103afba45dd867e1f5201280c7a 2023-07-12 22:15:32,110 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/.tmp/cf/3c65a103afba45dd867e1f5201280c7a as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/cf/3c65a103afba45dd867e1f5201280c7a 2023-07-12 22:15:32,111 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/.tmp/cf/5db1372816cd4838a47d4a029569e9b1 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/cf/5db1372816cd4838a47d4a029569e9b1 2023-07-12 22:15:32,120 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/cf/5db1372816cd4838a47d4a029569e9b1, entries=47, sequenceid=6, filesize=8 K 2023-07-12 22:15:32,121 INFO [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a0fc0bf9f736d9c574e5cd1876415ba2 in 141ms, sequenceid=6, compaction requested=false 2023-07-12 22:15:32,122 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 22:15:32,122 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0fc0bf9f736d9c574e5cd1876415ba2: 2023-07-12 22:15:32,122 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,123 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:32,123 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/cf/5db1372816cd4838a47d4a029569e9b1] hfiles 2023-07-12 22:15:32,123 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/cf/5db1372816cd4838a47d4a029569e9b1 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,123 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/cf/3c65a103afba45dd867e1f5201280c7a, entries=3, sequenceid=6, filesize=5.0 K 2023-07-12 22:15:32,124 INFO [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7bb6b0dcee0dc6f32e85400b6329415f in 145ms, sequenceid=6, compaction requested=false 2023-07-12 22:15:32,151 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7bb6b0dcee0dc6f32e85400b6329415f: 2023-07-12 22:15:32,152 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,152 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 22:15:32,152 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/cf/3c65a103afba45dd867e1f5201280c7a] hfiles 2023-07-12 22:15:32,152 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/cf/3c65a103afba45dd867e1f5201280c7a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,209 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:32,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:32,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 22:15:32,210 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 22:15:32,211 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. completed. 2023-07-12 22:15:32,211 DEBUG [rs(jenkins-hbase4.apache.org,34131,1689200016023)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34131,1689200016023' in zk 2023-07-12 22:15:32,213 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. completed. 2023-07-12 22:15:32,213 DEBUG [rs(jenkins-hbase4.apache.org,34577,1689200015954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:32,213 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 22:15:32,213 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 22:15:32,213 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,213 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 22:15:32,213 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34577,1689200015954' in zk 2023-07-12 22:15:32,214 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,214 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:32,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:32,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:32,214 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:32,214 DEBUG [member: 'jenkins-hbase4.apache.org,34131,1689200016023' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:32,218 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,218 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 22:15:32,218 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:32,218 DEBUG [member: 'jenkins-hbase4.apache.org,34577,1689200015954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 22:15:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34131,1689200016023': 2023-07-12 22:15:32,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34131,1689200016023' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 22:15:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:32,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34577,1689200015954': 2023-07-12 22:15:32,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34577,1689200015954' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 22:15:32,235 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 22:15:32,235 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 22:15:32,235 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 22:15:32,235 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,235 INFO [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 22:15:32,237 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,237 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,237 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,237 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,237 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,238 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,237 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 22:15:32,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 22:15:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,237 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,239 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 22:15:32,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,239 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 22:15:32,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,243 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,244 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 22:15:32,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,244 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,248 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:32,248 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:32,249 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:32,249 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,248 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:32,249 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 22:15:32,249 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 22:15:32,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 22:15:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 22:15:32,249 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,250 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,250 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,251 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,251 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:32,251 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,251 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:32,251 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:15:32,251 DEBUG [(jenkins-hbase4.apache.org,38945,1689200014307)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 22:15:32,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,251 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,251 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 22:15:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 22:15:32,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 22:15:32,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,355 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689200131904Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689200132251 (+347 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689200132251Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689200132264 (+13 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689200132308 (+44 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689200132354 (+46 ms) 2023-07-12 22:15:32,358 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 22:15:32,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 452 msec 2023-07-12 22:15:32,510 DEBUG [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 22:15:32,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 22:15:32,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 22:15:32,512 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512 2023-07-12 22:15:32,512 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34859, tgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512, rawTgtDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512, srcFsUri=hdfs://localhost:34859, srcDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:15:32,539 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3 2023-07-12 22:15:32,539 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-590443549_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,540 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34859, inputRoot=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3, snapshotDir=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 22:15:32,550 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:32,578 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,579 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,579 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,580 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,580 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,581 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,581 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,650 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/hadoop-4312837429664274490.jar 2023-07-12 22:15:32,651 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,651 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,652 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,652 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,652 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,652 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 22:15:32,653 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 22:15:32,653 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 22:15:32,654 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 22:15:32,654 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 22:15:32,654 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 22:15:32,655 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 22:15:32,655 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 22:15:32,655 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 22:15:32,656 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 22:15:32,657 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 22:15:32,657 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:32,658 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:32,658 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:32,659 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:32,659 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 22:15:32,660 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:32,660 DEBUG [Listener at jenkins-hbase4.apache.org/46373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 22:15:33,893 WARN [Listener at jenkins-hbase4.apache.org/46373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 22:15:33,896 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 22:15:33,899 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 22:15:34,326 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:34,327 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 22:15:34,329 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0006_000001 (auth:SIMPLE) 2023-07-12 22:15:35,031 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0007_000001 (auth:SIMPLE) 2023-07-12 22:15:36,101 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:15:41,171 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0007_000001 (auth:SIMPLE) 2023-07-12 22:15:43,496 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0007_000001 (auth:SIMPLE) 2023-07-12 22:15:48,753 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689200023416_0007_000001 (auth:SIMPLE) 2023-07-12 22:15:50,161 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 22:15:50,161 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 22:15:50,176 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,176 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 22:15:50,177 INFO [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 22:15:50,177 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,178 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 22:15:50,178 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 22:15:50,178 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_460260290_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,178 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 22:15:50,178 DEBUG [Listener at jenkins-hbase4.apache.org/46373] snapshot.TestExportSnapshot(367): hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/export-test/export-1689200132512/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 22:15:50,185 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 22:15:50,192 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200150192"}]},"ts":"1689200150192"} 2023-07-12 22:15:50,194 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 22:15:50,196 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 22:15:50,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7bb6b0dcee0dc6f32e85400b6329415f, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0fc0bf9f736d9c574e5cd1876415ba2, UNASSIGN}] 2023-07-12 22:15:50,199 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0fc0bf9f736d9c574e5cd1876415ba2, UNASSIGN 2023-07-12 22:15:50,199 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7bb6b0dcee0dc6f32e85400b6329415f, UNASSIGN 2023-07-12 22:15:50,200 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a0fc0bf9f736d9c574e5cd1876415ba2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:15:50,200 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7bb6b0dcee0dc6f32e85400b6329415f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:15:50,200 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200150200"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200150200"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200150200"}]},"ts":"1689200150200"} 2023-07-12 22:15:50,200 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200150200"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689200150200"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689200150200"}]},"ts":"1689200150200"} 2023-07-12 22:15:50,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure a0fc0bf9f736d9c574e5cd1876415ba2, server=jenkins-hbase4.apache.org,34577,1689200015954}] 2023-07-12 22:15:50,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 7bb6b0dcee0dc6f32e85400b6329415f, server=jenkins-hbase4.apache.org,34131,1689200016023}] 2023-07-12 22:15:50,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 22:15:50,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:50,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:50,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7bb6b0dcee0dc6f32e85400b6329415f, disabling compactions & flushes 2023-07-12 22:15:50,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a0fc0bf9f736d9c574e5cd1876415ba2, disabling compactions & flushes 2023-07-12 22:15:50,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:50,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:50,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:50,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:50,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. after waiting 0 ms 2023-07-12 22:15:50,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:50,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. after waiting 0 ms 2023-07-12 22:15:50,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:50,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:50,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:50,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f. 2023-07-12 22:15:50,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7bb6b0dcee0dc6f32e85400b6329415f: 2023-07-12 22:15:50,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:15:50,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:50,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:15:50,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2. 2023-07-12 22:15:50,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a0fc0bf9f736d9c574e5cd1876415ba2: 2023-07-12 22:15:50,378 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7bb6b0dcee0dc6f32e85400b6329415f, regionState=CLOSED 2023-07-12 22:15:50,378 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200150378"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200150378"}]},"ts":"1689200150378"} 2023-07-12 22:15:50,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:50,381 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a0fc0bf9f736d9c574e5cd1876415ba2, regionState=CLOSED 2023-07-12 22:15:50,381 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689200150381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689200150381"}]},"ts":"1689200150381"} 2023-07-12 22:15:50,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-12 22:15:50,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 7bb6b0dcee0dc6f32e85400b6329415f, server=jenkins-hbase4.apache.org,34131,1689200016023 in 177 msec 2023-07-12 22:15:50,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7bb6b0dcee0dc6f32e85400b6329415f, UNASSIGN in 185 msec 2023-07-12 22:15:50,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-12 22:15:50,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure a0fc0bf9f736d9c574e5cd1876415ba2, server=jenkins-hbase4.apache.org,34577,1689200015954 in 182 msec 2023-07-12 22:15:50,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-12 22:15:50,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a0fc0bf9f736d9c574e5cd1876415ba2, UNASSIGN in 187 msec 2023-07-12 22:15:50,387 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689200150387"}]},"ts":"1689200150387"} 2023-07-12 22:15:50,388 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 22:15:50,389 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 22:15:50,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 204 msec 2023-07-12 22:15:50,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 22:15:50,493 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 22:15:50,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,503 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,504 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,505 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45649] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,515 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:50,515 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,515 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,516 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,515 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,516 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 22:15:50,516 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 22:15:50,516 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 22:15:50,516 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 22:15:50,518 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:50,520 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,520 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:50,520 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,520 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,520 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:50,520 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,520 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:50,520 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 22:15:50,521 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/recovered.edits] 2023-07-12 22:15:50,521 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/cf, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/recovered.edits] 2023-07-12 22:15:50,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 22:15:50,531 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/cf/5db1372816cd4838a47d4a029569e9b1 to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/cf/5db1372816cd4838a47d4a029569e9b1 2023-07-12 22:15:50,531 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/cf/3c65a103afba45dd867e1f5201280c7a to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/cf/3c65a103afba45dd867e1f5201280c7a 2023-07-12 22:15:50,538 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f/recovered.edits/9.seqid 2023-07-12 22:15:50,538 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/recovered.edits/9.seqid to hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2/recovered.edits/9.seqid 2023-07-12 22:15:50,539 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7bb6b0dcee0dc6f32e85400b6329415f 2023-07-12 22:15:50,539 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a0fc0bf9f736d9c574e5cd1876415ba2 2023-07-12 22:15:50,539 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 22:15:50,541 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,544 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 22:15:50,546 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 22:15:50,547 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,547 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 22:15:50,548 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200150547"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:50,548 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689200150547"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:50,553 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 22:15:50,553 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7bb6b0dcee0dc6f32e85400b6329415f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689200130796.7bb6b0dcee0dc6f32e85400b6329415f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a0fc0bf9f736d9c574e5cd1876415ba2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689200130796.a0fc0bf9f736d9c574e5cd1876415ba2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 22:15:50,553 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 22:15:50,553 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689200150553"}]},"ts":"9223372036854775807"} 2023-07-12 22:15:50,556 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 22:15:50,558 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 64 msec 2023-07-12 22:15:50,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 22:15:50,623 INFO [Listener at jenkins-hbase4.apache.org/46373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 22:15:50,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 22:15:50,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 22:15:50,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38945] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 22:15:50,670 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 761) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:56480 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1717740785) connection to jenkins-hbase4.apache.org/172.31.14.131:40747 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5442 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:46904 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1576630331_1 at /127.0.0.1:43144 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_460260290_17 at /127.0.0.1:43168 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36d5a956-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1576630331_1 at /127.0.0.1:46882 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 905), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=819 (was 786) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=2911 (was 3222) 2023-07-12 22:15:50,670 WARN [Listener at jenkins-hbase4.apache.org/46373] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-12 22:15:50,670 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 22:15:50,685 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 22:15:50,799 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689200023416_0007_01_000001 is : 143 2023-07-12 22:15:55,974 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 22:16:04,813 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 22:16:18,935 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 22:16:18,935 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 22:16:19,046 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 22:16:19,058 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 22:16:19,059 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 22:16:19,079 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 22:16:19,183 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 22:16:19,183 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 22:16:19,183 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 22:16:19,183 INFO [Listener at jenkins-hbase4.apache.org/46373] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 22:16:19,183 DEBUG [Listener at jenkins-hbase4.apache.org/46373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49f3c037 to 127.0.0.1:50879 2023-07-12 22:16:19,184 DEBUG [Listener at jenkins-hbase4.apache.org/46373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,184 DEBUG [Listener at jenkins-hbase4.apache.org/46373] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 22:16:19,184 DEBUG [Listener at jenkins-hbase4.apache.org/46373] util.JVMClusterUtil(257): Found active master hash=2045771150, stopped=false 2023-07-12 22:16:19,184 DEBUG [Listener at jenkins-hbase4.apache.org/46373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,184 DEBUG [Listener at jenkins-hbase4.apache.org/46373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 22:16:19,184 INFO [Listener at jenkins-hbase4.apache.org/46373] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:16:19,186 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 22:16:19,186 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 22:16:19,186 INFO [Listener at jenkins-hbase4.apache.org/46373] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 22:16:19,186 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 22:16:19,186 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 22:16:19,186 DEBUG [Listener at jenkins-hbase4.apache.org/46373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5342c681 to 127.0.0.1:50879 2023-07-12 22:16:19,186 DEBUG [Listener at jenkins-hbase4.apache.org/46373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:16:19,186 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:16:19,186 INFO [Listener at jenkins-hbase4.apache.org/46373] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45649,1689200015893' ***** 2023-07-12 22:16:19,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:16:19,187 DEBUG [Listener at jenkins-hbase4.apache.org/46373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,187 INFO [Listener at jenkins-hbase4.apache.org/46373] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 22:16:19,187 INFO [Listener at jenkins-hbase4.apache.org/46373] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34577,1689200015954' ***** 2023-07-12 22:16:19,187 DEBUG [Listener at jenkins-hbase4.apache.org/46373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,187 INFO [Listener at jenkins-hbase4.apache.org/46373] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 22:16:19,187 INFO [Listener at jenkins-hbase4.apache.org/46373] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34131,1689200016023' ***** 2023-07-12 22:16:19,187 DEBUG [Listener at jenkins-hbase4.apache.org/46373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,187 INFO [RS:1;jenkins-hbase4:34577] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 22:16:19,187 INFO [RS:0;jenkins-hbase4:45649] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 22:16:19,187 INFO [Listener at jenkins-hbase4.apache.org/46373] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 22:16:19,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:16:19,188 INFO [RS:1;jenkins-hbase4:34577] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 22:16:19,188 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 22:16:19,188 INFO [RS:1;jenkins-hbase4:34577] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 22:16:19,188 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 22:16:19,188 INFO [RS:0;jenkins-hbase4:45649] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 22:16:19,188 INFO [RS:0;jenkins-hbase4:45649] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 22:16:19,188 INFO [RS:2;jenkins-hbase4:34131] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 22:16:19,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 22:16:19,188 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 22:16:19,188 INFO [RS:2;jenkins-hbase4:34131] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 22:16:19,188 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(3305): Received CLOSE for cedb9763ff93422ea823516ccf9edef5 2023-07-12 22:16:19,188 INFO [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:16:19,188 INFO [RS:2;jenkins-hbase4:34131] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 22:16:19,189 DEBUG [RS:1;jenkins-hbase4:34577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7045ebeb to 127.0.0.1:50879 2023-07-12 22:16:19,189 INFO [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:16:19,189 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(3305): Received CLOSE for e4b6145bffafa75395ae062c8e457129 2023-07-12 22:16:19,189 DEBUG [RS:2;jenkins-hbase4:34131] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6819b9c6 to 127.0.0.1:50879 2023-07-12 22:16:19,189 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:16:19,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cedb9763ff93422ea823516ccf9edef5, disabling compactions & flushes 2023-07-12 22:16:19,189 DEBUG [RS:1;jenkins-hbase4:34577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:16:19,190 DEBUG [RS:0;jenkins-hbase4:45649] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x103ad616 to 127.0.0.1:50879 2023-07-12 22:16:19,191 INFO [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34577,1689200015954; all regions closed. 2023-07-12 22:16:19,189 DEBUG [RS:2;jenkins-hbase4:34131] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,191 DEBUG [RS:0;jenkins-hbase4:45649] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:16:19,193 INFO [RS:0;jenkins-hbase4:45649] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 22:16:19,193 INFO [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34131,1689200016023; all regions closed. 2023-07-12 22:16:19,194 INFO [RS:0;jenkins-hbase4:45649] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 22:16:19,194 INFO [RS:0;jenkins-hbase4:45649] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 22:16:19,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. after waiting 0 ms 2023-07-12 22:16:19,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:16:19,194 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 22:16:19,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cedb9763ff93422ea823516ccf9edef5 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 22:16:19,194 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-12 22:16:19,194 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1478): Online Regions={cedb9763ff93422ea823516ccf9edef5=hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5., 1588230740=hbase:meta,,1.1588230740, e4b6145bffafa75395ae062c8e457129=hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129.} 2023-07-12 22:16:19,195 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1504): Waiting on 1588230740, cedb9763ff93422ea823516ccf9edef5, e4b6145bffafa75395ae062c8e457129 2023-07-12 22:16:19,196 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 22:16:19,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 22:16:19,196 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 22:16:19,196 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 22:16:19,196 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 22:16:19,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 22:16:19,268 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,270 DEBUG [RS:1;jenkins-hbase4:34577] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/oldWALs 2023-07-12 22:16:19,270 INFO [RS:1;jenkins-hbase4:34577] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34577%2C1689200015954:(num 1689200018171) 2023-07-12 22:16:19,270 DEBUG [RS:1;jenkins-hbase4:34577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,270 INFO [RS:1;jenkins-hbase4:34577] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,272 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,272 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,287 INFO [RS:1;jenkins-hbase4:34577] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 22:16:19,288 INFO [RS:1;jenkins-hbase4:34577] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 22:16:19,288 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 22:16:19,288 INFO [RS:1;jenkins-hbase4:34577] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 22:16:19,290 INFO [RS:1;jenkins-hbase4:34577] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 22:16:19,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5/.tmp/l/ccbba5392f784c888baae7b218fce715 2023-07-12 22:16:19,292 INFO [RS:1;jenkins-hbase4:34577] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34577 2023-07-12 22:16:19,296 DEBUG [RS:2;jenkins-hbase4:34131] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/oldWALs 2023-07-12 22:16:19,296 INFO [RS:2;jenkins-hbase4:34131] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34131%2C1689200016023:(num 1689200018180) 2023-07-12 22:16:19,296 DEBUG [RS:2;jenkins-hbase4:34131] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,296 INFO [RS:2;jenkins-hbase4:34131] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,297 INFO [RS:2;jenkins-hbase4:34131] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 22:16:19,298 INFO [RS:2;jenkins-hbase4:34131] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 22:16:19,298 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 22:16:19,298 INFO [RS:2;jenkins-hbase4:34131] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 22:16:19,298 INFO [RS:2;jenkins-hbase4:34131] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 22:16:19,299 INFO [RS:2;jenkins-hbase4:34131] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34131 2023-07-12 22:16:19,299 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:16:19,299 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:16:19,299 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,299 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,299 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34577,1689200015954 2023-07-12 22:16:19,299 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,300 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccbba5392f784c888baae7b218fce715 2023-07-12 22:16:19,301 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/.tmp/info/d7888e9190984cd488826e26212cb3e6 2023-07-12 22:16:19,301 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:16:19,301 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:16:19,301 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34131,1689200016023 2023-07-12 22:16:19,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5/.tmp/l/ccbba5392f784c888baae7b218fce715 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5/l/ccbba5392f784c888baae7b218fce715 2023-07-12 22:16:19,302 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34577,1689200015954] 2023-07-12 22:16:19,303 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34577,1689200015954; numProcessing=1 2023-07-12 22:16:19,304 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34577,1689200015954 already deleted, retry=false 2023-07-12 22:16:19,304 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34577,1689200015954 expired; onlineServers=2 2023-07-12 22:16:19,304 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34131,1689200016023] 2023-07-12 22:16:19,304 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34131,1689200016023; numProcessing=2 2023-07-12 22:16:19,306 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34131,1689200016023 already deleted, retry=false 2023-07-12 22:16:19,306 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34131,1689200016023 expired; onlineServers=1 2023-07-12 22:16:19,306 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7888e9190984cd488826e26212cb3e6 2023-07-12 22:16:19,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccbba5392f784c888baae7b218fce715 2023-07-12 22:16:19,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5/l/ccbba5392f784c888baae7b218fce715, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 22:16:19,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for cedb9763ff93422ea823516ccf9edef5 in 114ms, sequenceid=18, compaction requested=false 2023-07-12 22:16:19,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/acl/cedb9763ff93422ea823516ccf9edef5/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 22:16:19,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:16:19,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cedb9763ff93422ea823516ccf9edef5: 2023-07-12 22:16:19,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689200019576.cedb9763ff93422ea823516ccf9edef5. 2023-07-12 22:16:19,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4b6145bffafa75395ae062c8e457129, disabling compactions & flushes 2023-07-12 22:16:19,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:16:19,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:16:19,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. after waiting 0 ms 2023-07-12 22:16:19,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:16:19,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e4b6145bffafa75395ae062c8e457129 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 22:16:19,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/.tmp/rep_barrier/7f0f9600b8ea409583a6c3dfc78b51fc 2023-07-12 22:16:19,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f0f9600b8ea409583a6c3dfc78b51fc 2023-07-12 22:16:19,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129/.tmp/info/f0a568b8949b429db2bc97843b3b2903 2023-07-12 22:16:19,395 DEBUG [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1504): Waiting on 1588230740, e4b6145bffafa75395ae062c8e457129 2023-07-12 22:16:19,402 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,402 INFO [RS:1;jenkins-hbase4:34577] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34577,1689200015954; zookeeper connection closed. 2023-07-12 22:16:19,403 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34577-0x1015b99334c0002, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129/.tmp/info/f0a568b8949b429db2bc97843b3b2903 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129/info/f0a568b8949b429db2bc97843b3b2903 2023-07-12 22:16:19,406 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@47a61d40] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@47a61d40 2023-07-12 22:16:19,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129/info/f0a568b8949b429db2bc97843b3b2903, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 22:16:19,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e4b6145bffafa75395ae062c8e457129 in 86ms, sequenceid=6, compaction requested=false 2023-07-12 22:16:19,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/.tmp/table/9cd90811a94349a486e304f7c2b0cbe7 2023-07-12 22:16:19,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cd90811a94349a486e304f7c2b0cbe7 2023-07-12 22:16:19,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/.tmp/info/d7888e9190984cd488826e26212cb3e6 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/info/d7888e9190984cd488826e26212cb3e6 2023-07-12 22:16:19,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/namespace/e4b6145bffafa75395ae062c8e457129/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 22:16:19,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:16:19,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4b6145bffafa75395ae062c8e457129: 2023-07-12 22:16:19,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689200018846.e4b6145bffafa75395ae062c8e457129. 2023-07-12 22:16:19,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7888e9190984cd488826e26212cb3e6 2023-07-12 22:16:19,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/info/d7888e9190984cd488826e26212cb3e6, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 22:16:19,469 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/.tmp/rep_barrier/7f0f9600b8ea409583a6c3dfc78b51fc as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/rep_barrier/7f0f9600b8ea409583a6c3dfc78b51fc 2023-07-12 22:16:19,474 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f0f9600b8ea409583a6c3dfc78b51fc 2023-07-12 22:16:19,475 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/rep_barrier/7f0f9600b8ea409583a6c3dfc78b51fc, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 22:16:19,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/.tmp/table/9cd90811a94349a486e304f7c2b0cbe7 as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/table/9cd90811a94349a486e304f7c2b0cbe7 2023-07-12 22:16:19,491 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cd90811a94349a486e304f7c2b0cbe7 2023-07-12 22:16:19,491 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/table/9cd90811a94349a486e304f7c2b0cbe7, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 22:16:19,492 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 296ms, sequenceid=131, compaction requested=false 2023-07-12 22:16:19,502 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,503 INFO [RS:2;jenkins-hbase4:34131] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34131,1689200016023; zookeeper connection closed. 2023-07-12 22:16:19,503 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:34131-0x1015b99334c0003, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,507 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@616aeaa0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@616aeaa0 2023-07-12 22:16:19,515 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 22:16:19,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 22:16:19,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 22:16:19,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 22:16:19,517 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 22:16:19,517 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 22:16:19,596 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45649,1689200015893; all regions closed. 2023-07-12 22:16:19,607 DEBUG [RS:0;jenkins-hbase4:45649] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/oldWALs 2023-07-12 22:16:19,607 INFO [RS:0;jenkins-hbase4:45649] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45649%2C1689200015893.meta:.meta(num 1689200018519) 2023-07-12 22:16:19,616 DEBUG [RS:0;jenkins-hbase4:45649] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/oldWALs 2023-07-12 22:16:19,616 INFO [RS:0;jenkins-hbase4:45649] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45649%2C1689200015893:(num 1689200018183) 2023-07-12 22:16:19,616 DEBUG [RS:0;jenkins-hbase4:45649] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,616 INFO [RS:0;jenkins-hbase4:45649] regionserver.LeaseManager(133): Closed leases 2023-07-12 22:16:19,616 INFO [RS:0;jenkins-hbase4:45649] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 22:16:19,616 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 22:16:19,617 INFO [RS:0;jenkins-hbase4:45649] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45649 2023-07-12 22:16:19,619 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 22:16:19,619 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45649,1689200015893 2023-07-12 22:16:19,620 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45649,1689200015893] 2023-07-12 22:16:19,620 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45649,1689200015893; numProcessing=3 2023-07-12 22:16:19,623 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45649,1689200015893 already deleted, retry=false 2023-07-12 22:16:19,623 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45649,1689200015893 expired; onlineServers=0 2023-07-12 22:16:19,623 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38945,1689200014307' ***** 2023-07-12 22:16:19,623 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 22:16:19,623 DEBUG [M:0;jenkins-hbase4:38945] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38d2f7b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 22:16:19,623 INFO [M:0;jenkins-hbase4:38945] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38945,1689200014307 2023-07-12 22:16:19,623 INFO [M:0;jenkins-hbase4:38945] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38945,1689200014307; all regions closed. 2023-07-12 22:16:19,623 DEBUG [M:0;jenkins-hbase4:38945] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 22:16:19,623 DEBUG [M:0;jenkins-hbase4:38945] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 22:16:19,623 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 22:16:19,624 DEBUG [M:0;jenkins-hbase4:38945] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 22:16:19,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689200017695] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689200017695,5,FailOnTimeoutGroup] 2023-07-12 22:16:19,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689200017699] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689200017699,5,FailOnTimeoutGroup] 2023-07-12 22:16:19,624 INFO [M:0;jenkins-hbase4:38945] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 22:16:19,624 INFO [M:0;jenkins-hbase4:38945] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 22:16:19,624 INFO [M:0;jenkins-hbase4:38945] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-12 22:16:19,624 DEBUG [M:0;jenkins-hbase4:38945] master.HMaster(1512): Stopping service threads 2023-07-12 22:16:19,624 INFO [M:0;jenkins-hbase4:38945] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 22:16:19,624 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 22:16:19,624 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 22:16:19,625 ERROR [M:0;jenkins-hbase4:38945] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 22:16:19,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 22:16:19,625 INFO [M:0;jenkins-hbase4:38945] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 22:16:19,625 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 22:16:19,626 DEBUG [M:0;jenkins-hbase4:38945] zookeeper.ZKUtil(398): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 22:16:19,626 WARN [M:0;jenkins-hbase4:38945] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 22:16:19,626 INFO [M:0;jenkins-hbase4:38945] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 22:16:19,626 INFO [M:0;jenkins-hbase4:38945] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 22:16:19,627 DEBUG [M:0;jenkins-hbase4:38945] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 22:16:19,627 INFO [M:0;jenkins-hbase4:38945] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:16:19,627 DEBUG [M:0;jenkins-hbase4:38945] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:16:19,628 DEBUG [M:0;jenkins-hbase4:38945] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 22:16:19,628 DEBUG [M:0;jenkins-hbase4:38945] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:16:19,628 INFO [M:0;jenkins-hbase4:38945] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.35 KB heapSize=449.66 KB 2023-07-12 22:16:19,671 INFO [M:0;jenkins-hbase4:38945] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.35 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d20660e669f543fcbfa9580ffc865c5a 2023-07-12 22:16:19,676 INFO [M:0;jenkins-hbase4:38945] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d20660e669f543fcbfa9580ffc865c5a 2023-07-12 22:16:19,678 DEBUG [M:0;jenkins-hbase4:38945] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d20660e669f543fcbfa9580ffc865c5a as hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d20660e669f543fcbfa9580ffc865c5a 2023-07-12 22:16:19,684 INFO [M:0;jenkins-hbase4:38945] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d20660e669f543fcbfa9580ffc865c5a 2023-07-12 22:16:19,685 INFO [M:0;jenkins-hbase4:38945] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/b79fae5b-9972-0bf4-4eeb-1bd1c0c06ea3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d20660e669f543fcbfa9580ffc865c5a, entries=119, sequenceid=899, filesize=28.5 K 2023-07-12 22:16:19,686 INFO [M:0;jenkins-hbase4:38945] regionserver.HRegion(2948): Finished flush of dataSize ~373.35 KB/382314, heapSize ~449.65 KB/460440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 58ms, sequenceid=899, compaction requested=false 2023-07-12 22:16:19,691 INFO [M:0;jenkins-hbase4:38945] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 22:16:19,691 DEBUG [M:0;jenkins-hbase4:38945] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 22:16:19,703 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 22:16:19,703 INFO [M:0;jenkins-hbase4:38945] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 22:16:19,704 INFO [M:0;jenkins-hbase4:38945] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38945 2023-07-12 22:16:19,706 DEBUG [M:0;jenkins-hbase4:38945] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38945,1689200014307 already deleted, retry=false 2023-07-12 22:16:19,724 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,724 INFO [RS:0;jenkins-hbase4:45649] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45649,1689200015893; zookeeper connection closed. 2023-07-12 22:16:19,724 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x1015b99334c0001, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,724 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@58a8f185] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@58a8f185 2023-07-12 22:16:19,724 INFO [Listener at jenkins-hbase4.apache.org/46373] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 22:16:19,824 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,824 DEBUG [Listener at localhost/36101-EventThread] zookeeper.ZKWatcher(600): master:38945-0x1015b99334c0000, quorum=127.0.0.1:50879, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 22:16:19,824 INFO [M:0;jenkins-hbase4:38945] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38945,1689200014307; zookeeper connection closed. 2023-07-12 22:16:19,826 WARN [Listener at jenkins-hbase4.apache.org/46373] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 22:16:19,831 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 22:16:19,937 WARN [BP-846221032-172.31.14.131-1689200010297 heartbeating to localhost/127.0.0.1:34859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 22:16:19,937 WARN [BP-846221032-172.31.14.131-1689200010297 heartbeating to localhost/127.0.0.1:34859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-846221032-172.31.14.131-1689200010297 (Datanode Uuid 922c7626-40d7-4581-bd8a-55f62ccbecd4) service to localhost/127.0.0.1:34859 2023-07-12 22:16:19,940 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data5/current/BP-846221032-172.31.14.131-1689200010297] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:19,940 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data6/current/BP-846221032-172.31.14.131-1689200010297] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:19,945 WARN [Listener at jenkins-hbase4.apache.org/46373] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 22:16:19,954 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 22:16:20,057 WARN [BP-846221032-172.31.14.131-1689200010297 heartbeating to localhost/127.0.0.1:34859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 22:16:20,057 WARN [BP-846221032-172.31.14.131-1689200010297 heartbeating to localhost/127.0.0.1:34859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-846221032-172.31.14.131-1689200010297 (Datanode Uuid c3263a04-8e59-4900-bd26-8a4bb86024a6) service to localhost/127.0.0.1:34859 2023-07-12 22:16:20,058 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data3/current/BP-846221032-172.31.14.131-1689200010297] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,058 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data4/current/BP-846221032-172.31.14.131-1689200010297] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,060 WARN [Listener at jenkins-hbase4.apache.org/46373] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 22:16:20,066 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 22:16:20,168 WARN [BP-846221032-172.31.14.131-1689200010297 heartbeating to localhost/127.0.0.1:34859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 22:16:20,170 WARN [BP-846221032-172.31.14.131-1689200010297 heartbeating to localhost/127.0.0.1:34859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-846221032-172.31.14.131-1689200010297 (Datanode Uuid 2bd28d4d-fe99-49ea-b922-3ec1a910880c) service to localhost/127.0.0.1:34859 2023-07-12 22:16:20,171 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data1/current/BP-846221032-172.31.14.131-1689200010297] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,171 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f78aa77a-fc9a-098c-bce4-dbeab4c4ab3a/cluster_b2169420-805b-c755-ee6d-220a2ba9b268/dfs/data/data2/current/BP-846221032-172.31.14.131-1689200010297] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 22:16:20,206 INFO [Listener at jenkins-hbase4.apache.org/46373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 22:16:20,350 INFO [Listener at jenkins-hbase4.apache.org/46373] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 22:16:20,462 INFO [Listener at jenkins-hbase4.apache.org/46373] hbase.HBaseTestingUtility(1293): Minicluster is down