2023-07-23 15:06:42,233 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-23 15:06:42,472 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6 2023-07-23 15:06:42,472 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-23 15:06:42,472 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-23 15:06:42,509 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-23 15:06:42,772 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-23 15:06:42,773 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57, deleteOnExit=true 2023-07-23 15:06:42,773 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-23 15:06:42,774 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/test.cache.data in system properties and HBase conf 2023-07-23 15:06:42,774 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 15:06:42,775 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop.log.dir in system properties and HBase conf 2023-07-23 15:06:42,775 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 15:06:42,776 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 15:06:42,776 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 15:06:43,155 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-23 15:06:43,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 15:06:43,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 15:06:43,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 15:06:43,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 15:06:43,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 15:06:43,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 15:06:43,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 15:06:43,164 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 15:06:43,164 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 15:06:43,165 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/nfs.dump.dir in system properties and HBase conf 2023-07-23 15:06:43,165 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir in system properties and HBase conf 2023-07-23 15:06:43,166 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 15:06:43,166 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 15:06:43,167 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-23 15:06:43,793 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 15:06:43,797 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 15:06:44,095 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-23 15:06:44,299 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-23 15:06:44,315 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:44,362 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:44,399 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir/Jetty_localhost_43127_hdfs____il7oqp/webapp 2023-07-23 15:06:44,561 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43127 2023-07-23 15:06:44,605 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 15:06:44,605 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 15:06:45,132 WARN [Listener at localhost/44181] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 15:06:45,218 WARN [Listener at localhost/44181] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 15:06:45,245 WARN [Listener at localhost/44181] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:45,253 INFO [Listener at localhost/44181] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:45,270 INFO [Listener at localhost/44181] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir/Jetty_localhost_39957_datanode____.7n76lg/webapp 2023-07-23 15:06:45,395 INFO [Listener at localhost/44181] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39957 2023-07-23 15:06:45,944 WARN [Listener at localhost/46715] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 15:06:46,042 WARN [Listener at localhost/46715] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 15:06:46,056 WARN [Listener at localhost/46715] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:46,060 INFO [Listener at localhost/46715] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:46,069 INFO [Listener at localhost/46715] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir/Jetty_localhost_42941_datanode____.uqvsgx/webapp 2023-07-23 15:06:46,237 INFO [Listener at localhost/46715] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42941 2023-07-23 15:06:46,286 WARN [Listener at localhost/42247] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 15:06:46,395 WARN [Listener at localhost/42247] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 15:06:46,407 WARN [Listener at localhost/42247] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:46,409 INFO [Listener at localhost/42247] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:46,422 INFO [Listener at localhost/42247] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir/Jetty_localhost_40475_datanode____u2uvb1/webapp 2023-07-23 15:06:46,611 INFO [Listener at localhost/42247] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40475 2023-07-23 15:06:46,647 WARN [Listener at localhost/45147] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 15:06:46,801 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x757724696fec974c: Processing first storage report for DS-d5be584c-8d53-483b-8eca-d81233a3c962 from datanode 83321bb4-015f-4e97-b728-f7d7c591adae 2023-07-23 15:06:46,803 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x757724696fec974c: from storage DS-d5be584c-8d53-483b-8eca-d81233a3c962 node DatanodeRegistration(127.0.0.1:41123, datanodeUuid=83321bb4-015f-4e97-b728-f7d7c591adae, infoPort=33417, infoSecurePort=0, ipcPort=46715, storageInfo=lv=-57;cid=testClusterID;nsid=133320373;c=1690124803866), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,804 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ba6c7704d2a1ce: Processing first storage report for DS-ece8b966-f9dd-4808-b155-42b476a96379 from datanode daba712e-ac04-4416-9e69-583b1482ee4b 2023-07-23 15:06:46,804 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ba6c7704d2a1ce: from storage DS-ece8b966-f9dd-4808-b155-42b476a96379 node DatanodeRegistration(127.0.0.1:44243, datanodeUuid=daba712e-ac04-4416-9e69-583b1482ee4b, infoPort=34993, infoSecurePort=0, ipcPort=42247, storageInfo=lv=-57;cid=testClusterID;nsid=133320373;c=1690124803866), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,804 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x757724696fec974c: Processing first storage report for DS-6e443eb4-050e-4c52-b315-d4c504938cc6 from datanode 83321bb4-015f-4e97-b728-f7d7c591adae 2023-07-23 15:06:46,804 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x757724696fec974c: from storage DS-6e443eb4-050e-4c52-b315-d4c504938cc6 node DatanodeRegistration(127.0.0.1:41123, datanodeUuid=83321bb4-015f-4e97-b728-f7d7c591adae, infoPort=33417, infoSecurePort=0, ipcPort=46715, storageInfo=lv=-57;cid=testClusterID;nsid=133320373;c=1690124803866), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,805 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ba6c7704d2a1ce: Processing first storage report for DS-72b352c6-d1e0-461d-93d1-fe1543578639 from datanode daba712e-ac04-4416-9e69-583b1482ee4b 2023-07-23 15:06:46,805 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ba6c7704d2a1ce: from storage DS-72b352c6-d1e0-461d-93d1-fe1543578639 node DatanodeRegistration(127.0.0.1:44243, datanodeUuid=daba712e-ac04-4416-9e69-583b1482ee4b, infoPort=34993, infoSecurePort=0, ipcPort=42247, storageInfo=lv=-57;cid=testClusterID;nsid=133320373;c=1690124803866), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,859 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x93ee41ee139de4db: Processing first storage report for DS-ebe33f19-5712-40a8-bb62-77779fdd5a25 from datanode 8aafb742-18ec-4c12-8037-f64393a49c39 2023-07-23 15:06:46,859 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x93ee41ee139de4db: from storage DS-ebe33f19-5712-40a8-bb62-77779fdd5a25 node DatanodeRegistration(127.0.0.1:39765, datanodeUuid=8aafb742-18ec-4c12-8037-f64393a49c39, infoPort=37131, infoSecurePort=0, ipcPort=45147, storageInfo=lv=-57;cid=testClusterID;nsid=133320373;c=1690124803866), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 15:06:46,859 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x93ee41ee139de4db: Processing first storage report for DS-223654f4-a116-4b2f-b797-9a0de23fd4bf from datanode 8aafb742-18ec-4c12-8037-f64393a49c39 2023-07-23 15:06:46,859 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x93ee41ee139de4db: from storage DS-223654f4-a116-4b2f-b797-9a0de23fd4bf node DatanodeRegistration(127.0.0.1:39765, datanodeUuid=8aafb742-18ec-4c12-8037-f64393a49c39, infoPort=37131, infoSecurePort=0, ipcPort=45147, storageInfo=lv=-57;cid=testClusterID;nsid=133320373;c=1690124803866), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 15:06:47,098 DEBUG [Listener at localhost/45147] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6 2023-07-23 15:06:47,186 INFO [Listener at localhost/45147] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/zookeeper_0, clientPort=63816, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-23 15:06:47,207 INFO [Listener at localhost/45147] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63816 2023-07-23 15:06:47,215 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:47,218 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:47,911 INFO [Listener at localhost/45147] util.FSUtils(471): Created version file at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 with version=8 2023-07-23 15:06:47,912 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/hbase-staging 2023-07-23 15:06:48,347 INFO [Listener at localhost/45147] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-23 15:06:48,955 INFO [Listener at localhost/45147] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 15:06:49,000 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,001 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,001 INFO [Listener at localhost/45147] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 15:06:49,002 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,002 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 15:06:49,172 INFO [Listener at localhost/45147] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 15:06:49,252 DEBUG [Listener at localhost/45147] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-23 15:06:49,379 INFO [Listener at localhost/45147] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37385 2023-07-23 15:06:49,398 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,401 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,431 INFO [Listener at localhost/45147] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37385 connecting to ZooKeeper ensemble=127.0.0.1:63816 2023-07-23 15:06:49,479 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:373850x0, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 15:06:49,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37385-0x10192b86f000000 connected 2023-07-23 15:06:49,529 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:06:49,530 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:06:49,549 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 15:06:49,562 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37385 2023-07-23 15:06:49,567 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37385 2023-07-23 15:06:49,568 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37385 2023-07-23 15:06:49,580 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37385 2023-07-23 15:06:49,580 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37385 2023-07-23 15:06:49,588 INFO [Listener at localhost/45147] master.HMaster(444): hbase.rootdir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661, hbase.cluster.distributed=false 2023-07-23 15:06:49,667 INFO [Listener at localhost/45147] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 15:06:49,667 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,668 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,668 INFO [Listener at localhost/45147] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 15:06:49,668 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,668 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 15:06:49,673 INFO [Listener at localhost/45147] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 15:06:49,677 INFO [Listener at localhost/45147] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38883 2023-07-23 15:06:49,680 INFO [Listener at localhost/45147] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 15:06:49,688 INFO [Listener at localhost/45147] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 15:06:49,690 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,692 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,694 INFO [Listener at localhost/45147] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38883 connecting to ZooKeeper ensemble=127.0.0.1:63816 2023-07-23 15:06:49,701 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:388830x0, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 15:06:49,702 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): regionserver:388830x0, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:06:49,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38883-0x10192b86f000001 connected 2023-07-23 15:06:49,704 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:06:49,706 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 15:06:49,711 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38883 2023-07-23 15:06:49,711 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38883 2023-07-23 15:06:49,711 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38883 2023-07-23 15:06:49,714 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38883 2023-07-23 15:06:49,715 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38883 2023-07-23 15:06:49,737 INFO [Listener at localhost/45147] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 15:06:49,737 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,738 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,738 INFO [Listener at localhost/45147] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 15:06:49,739 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,739 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 15:06:49,739 INFO [Listener at localhost/45147] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 15:06:49,750 INFO [Listener at localhost/45147] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41023 2023-07-23 15:06:49,751 INFO [Listener at localhost/45147] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 15:06:49,752 INFO [Listener at localhost/45147] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 15:06:49,753 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,755 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,758 INFO [Listener at localhost/45147] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41023 connecting to ZooKeeper ensemble=127.0.0.1:63816 2023-07-23 15:06:49,765 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:410230x0, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 15:06:49,766 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): regionserver:410230x0, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:06:49,767 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): regionserver:410230x0, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:06:49,768 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): regionserver:410230x0, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 15:06:49,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41023-0x10192b86f000002 connected 2023-07-23 15:06:49,774 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41023 2023-07-23 15:06:49,775 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41023 2023-07-23 15:06:49,788 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41023 2023-07-23 15:06:49,789 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41023 2023-07-23 15:06:49,790 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41023 2023-07-23 15:06:49,803 INFO [Listener at localhost/45147] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 15:06:49,803 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,803 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,803 INFO [Listener at localhost/45147] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 15:06:49,803 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 15:06:49,803 INFO [Listener at localhost/45147] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 15:06:49,804 INFO [Listener at localhost/45147] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 15:06:49,805 INFO [Listener at localhost/45147] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42581 2023-07-23 15:06:49,806 INFO [Listener at localhost/45147] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 15:06:49,808 INFO [Listener at localhost/45147] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 15:06:49,809 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,811 INFO [Listener at localhost/45147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:49,812 INFO [Listener at localhost/45147] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42581 connecting to ZooKeeper ensemble=127.0.0.1:63816 2023-07-23 15:06:49,817 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:425810x0, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 15:06:49,818 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): regionserver:425810x0, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:06:49,818 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): regionserver:425810x0, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:06:49,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42581-0x10192b86f000003 connected 2023-07-23 15:06:49,820 DEBUG [Listener at localhost/45147] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 15:06:49,822 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42581 2023-07-23 15:06:49,826 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42581 2023-07-23 15:06:49,827 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42581 2023-07-23 15:06:49,827 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42581 2023-07-23 15:06:49,828 DEBUG [Listener at localhost/45147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42581 2023-07-23 15:06:49,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:06:49,841 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 15:06:49,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:06:49,870 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 15:06:49,870 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 15:06:49,870 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 15:06:49,870 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 15:06:49,872 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:49,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 15:06:49,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 15:06:49,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37385,1690124808099 from backup master directory 2023-07-23 15:06:49,880 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:06:49,880 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 15:06:49,881 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 15:06:49,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:06:49,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-23 15:06:49,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-23 15:06:50,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/hbase.id with ID: 0516c9dd-cec0-4c38-b147-e5478b45dc7a 2023-07-23 15:06:50,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 15:06:50,070 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:50,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x23cfa61b to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:50,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@229677ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:50,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:06:50,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-23 15:06:50,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-23 15:06:50,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-23 15:06:50,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 15:06:50,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 15:06:50,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:50,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/data/master/store-tmp 2023-07-23 15:06:50,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:50,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 15:06:50,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:06:50,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:06:50,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 15:06:50,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:06:50,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:06:50,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 15:06:50,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/WALs/jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:06:50,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37385%2C1690124808099, suffix=, logDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/WALs/jenkins-hbase4.apache.org,37385,1690124808099, archiveDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/oldWALs, maxLogs=10 2023-07-23 15:06:50,497 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK] 2023-07-23 15:06:50,497 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK] 2023-07-23 15:06:50,499 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK] 2023-07-23 15:06:50,507 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-23 15:06:50,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/WALs/jenkins-hbase4.apache.org,37385,1690124808099/jenkins-hbase4.apache.org%2C37385%2C1690124808099.1690124810430 2023-07-23 15:06:50,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK], DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK], DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK]] 2023-07-23 15:06:50,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:06:50,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:50,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,716 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,725 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-23 15:06:50,760 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-23 15:06:50,773 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:50,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 15:06:50,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:50,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74016461, jitterRate=0.10293121635913849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:50,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 15:06:50,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-23 15:06:50,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-23 15:06:50,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-23 15:06:50,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-23 15:06:50,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-23 15:06:50,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-23 15:06:50,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-23 15:06:50,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-23 15:06:50,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-23 15:06:50,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-23 15:06:50,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-23 15:06:50,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-23 15:06:50,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-23 15:06:50,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-23 15:06:50,990 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:51,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-23 15:06:51,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-23 15:06:51,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-23 15:06:51,026 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 15:06:51,026 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 15:06:51,026 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 15:06:51,026 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 15:06:51,027 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:51,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37385,1690124808099, sessionid=0x10192b86f000000, setting cluster-up flag (Was=false) 2023-07-23 15:06:51,050 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:51,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-23 15:06:51,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:06:51,072 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:51,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-23 15:06:51,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:06:51,085 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp 2023-07-23 15:06:51,137 INFO [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(951): ClusterId : 0516c9dd-cec0-4c38-b147-e5478b45dc7a 2023-07-23 15:06:51,152 INFO [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(951): ClusterId : 0516c9dd-cec0-4c38-b147-e5478b45dc7a 2023-07-23 15:06:51,139 INFO [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(951): ClusterId : 0516c9dd-cec0-4c38-b147-e5478b45dc7a 2023-07-23 15:06:51,163 DEBUG [RS:2;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 15:06:51,163 DEBUG [RS:0;jenkins-hbase4:38883] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 15:06:51,163 DEBUG [RS:1;jenkins-hbase4:41023] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 15:06:51,171 DEBUG [RS:1;jenkins-hbase4:41023] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 15:06:51,172 DEBUG [RS:1;jenkins-hbase4:41023] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 15:06:51,172 DEBUG [RS:2;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 15:06:51,172 DEBUG [RS:0;jenkins-hbase4:38883] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 15:06:51,172 DEBUG [RS:2;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 15:06:51,172 DEBUG [RS:0;jenkins-hbase4:38883] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 15:06:51,178 DEBUG [RS:1;jenkins-hbase4:41023] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 15:06:51,180 DEBUG [RS:0;jenkins-hbase4:38883] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 15:06:51,184 DEBUG [RS:0;jenkins-hbase4:38883] zookeeper.ReadOnlyZKClient(139): Connect 0x502d5efb to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:51,184 DEBUG [RS:1;jenkins-hbase4:41023] zookeeper.ReadOnlyZKClient(139): Connect 0x45129a40 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:51,186 DEBUG [RS:2;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 15:06:51,200 DEBUG [RS:2;jenkins-hbase4:42581] zookeeper.ReadOnlyZKClient(139): Connect 0x036d33ea to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:51,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-23 15:06:51,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:51,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-23 15:06:51,255 DEBUG [RS:2;jenkins-hbase4:42581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79f3d0a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:51,257 DEBUG [RS:2;jenkins-hbase4:42581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3930c9d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 15:06:51,292 DEBUG [RS:1;jenkins-hbase4:41023] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11bb426d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:51,292 DEBUG [RS:0;jenkins-hbase4:38883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@152fca9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:51,292 DEBUG [RS:1;jenkins-hbase4:41023] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36692396, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 15:06:51,293 DEBUG [RS:0;jenkins-hbase4:38883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24f01f64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 15:06:51,313 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38883 2023-07-23 15:06:51,313 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41023 2023-07-23 15:06:51,317 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42581 2023-07-23 15:06:51,325 INFO [RS:1;jenkins-hbase4:41023] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 15:06:51,326 INFO [RS:1;jenkins-hbase4:41023] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 15:06:51,326 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 15:06:51,326 INFO [RS:0;jenkins-hbase4:38883] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 15:06:51,328 INFO [RS:0;jenkins-hbase4:38883] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 15:06:51,325 INFO [RS:2;jenkins-hbase4:42581] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 15:06:51,328 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 15:06:51,328 INFO [RS:2;jenkins-hbase4:42581] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 15:06:51,327 INFO [RS:1;jenkins-hbase4:41023] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:51,328 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 15:06:51,328 INFO [RS:0;jenkins-hbase4:38883] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:51,329 INFO [RS:2;jenkins-hbase4:42581] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:51,329 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 15:06:51,328 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 15:06:51,329 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 15:06:51,332 INFO [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37385,1690124808099 with isa=jenkins-hbase4.apache.org/172.31.14.131:41023, startcode=1690124809736 2023-07-23 15:06:51,332 INFO [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37385,1690124808099 with isa=jenkins-hbase4.apache.org/172.31.14.131:38883, startcode=1690124809666 2023-07-23 15:06:51,332 INFO [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37385,1690124808099 with isa=jenkins-hbase4.apache.org/172.31.14.131:42581, startcode=1690124809802 2023-07-23 15:06:51,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-23 15:06:51,356 DEBUG [RS:0;jenkins-hbase4:38883] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 15:06:51,356 DEBUG [RS:1;jenkins-hbase4:41023] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 15:06:51,356 DEBUG [RS:2;jenkins-hbase4:42581] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 15:06:51,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 15:06:51,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 15:06:51,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 15:06:51,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 15:06:51,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-23 15:06:51,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 15:06:51,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690124841388 2023-07-23 15:06:51,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-23 15:06:51,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-23 15:06:51,413 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 15:06:51,414 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-23 15:06:51,426 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 15:06:51,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-23 15:06:51,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-23 15:06:51,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-23 15:06:51,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-23 15:06:51,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-23 15:06:51,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-23 15:06:51,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-23 15:06:51,438 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45563, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 15:06:51,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-23 15:06:51,439 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60731, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 15:06:51,443 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52613, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 15:06:51,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-23 15:06:51,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690124811447,5,FailOnTimeoutGroup] 2023-07-23 15:06:51,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690124811455,5,FailOnTimeoutGroup] 2023-07-23 15:06:51,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-23 15:06:51,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,475 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37385] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:06:51,498 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37385] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:51,504 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37385] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:51,511 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:06:51,512 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:06:51,512 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:06:51,512 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44181 2023-07-23 15:06:51,512 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44181 2023-07-23 15:06:51,513 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 15:06:51,513 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 15:06:51,512 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44181 2023-07-23 15:06:51,518 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 15:06:51,528 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:06:51,534 DEBUG [RS:0;jenkins-hbase4:38883] zookeeper.ZKUtil(162): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:06:51,534 DEBUG [RS:1;jenkins-hbase4:41023] zookeeper.ZKUtil(162): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:51,535 DEBUG [RS:2;jenkins-hbase4:42581] zookeeper.ZKUtil(162): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:51,535 WARN [RS:2;jenkins-hbase4:42581] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 15:06:51,534 WARN [RS:0;jenkins-hbase4:38883] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 15:06:51,534 WARN [RS:1;jenkins-hbase4:41023] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 15:06:51,535 INFO [RS:2;jenkins-hbase4:42581] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:51,539 INFO [RS:0;jenkins-hbase4:38883] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:51,541 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:51,541 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:06:51,539 INFO [RS:1;jenkins-hbase4:41023] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:51,542 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:51,547 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:51,551 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:51,551 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:06:51,538 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38883,1690124809666] 2023-07-23 15:06:51,559 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41023,1690124809736] 2023-07-23 15:06:51,559 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42581,1690124809802] 2023-07-23 15:06:51,589 DEBUG [RS:2;jenkins-hbase4:42581] zookeeper.ZKUtil(162): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:51,589 DEBUG [RS:0;jenkins-hbase4:38883] zookeeper.ZKUtil(162): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:51,591 DEBUG [RS:2;jenkins-hbase4:42581] zookeeper.ZKUtil(162): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:06:51,591 DEBUG [RS:0;jenkins-hbase4:38883] zookeeper.ZKUtil(162): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:06:51,592 DEBUG [RS:2;jenkins-hbase4:42581] zookeeper.ZKUtil(162): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:51,592 DEBUG [RS:0;jenkins-hbase4:38883] zookeeper.ZKUtil(162): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:51,600 DEBUG [RS:1;jenkins-hbase4:41023] zookeeper.ZKUtil(162): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:51,601 DEBUG [RS:1;jenkins-hbase4:41023] zookeeper.ZKUtil(162): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:06:51,601 DEBUG [RS:1;jenkins-hbase4:41023] zookeeper.ZKUtil(162): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:51,612 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 15:06:51,612 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 15:06:51,612 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 15:06:51,637 INFO [RS:1;jenkins-hbase4:41023] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 15:06:51,639 INFO [RS:0;jenkins-hbase4:38883] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 15:06:51,639 INFO [RS:2;jenkins-hbase4:42581] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 15:06:51,650 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:51,653 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 15:06:51,657 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/info 2023-07-23 15:06:51,658 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 15:06:51,659 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:51,659 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 15:06:51,662 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/rep_barrier 2023-07-23 15:06:51,662 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 15:06:51,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:51,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 15:06:51,666 INFO [RS:1;jenkins-hbase4:41023] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 15:06:51,666 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/table 2023-07-23 15:06:51,671 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 15:06:51,672 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:51,669 INFO [RS:2;jenkins-hbase4:42581] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 15:06:51,669 INFO [RS:0;jenkins-hbase4:38883] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 15:06:51,677 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740 2023-07-23 15:06:51,678 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740 2023-07-23 15:06:51,679 INFO [RS:1;jenkins-hbase4:41023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 15:06:51,679 INFO [RS:1;jenkins-hbase4:41023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,682 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 15:06:51,684 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 15:06:51,683 INFO [RS:2;jenkins-hbase4:42581] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 15:06:51,690 INFO [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 15:06:51,691 INFO [RS:0;jenkins-hbase4:38883] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 15:06:51,691 INFO [RS:0;jenkins-hbase4:38883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,690 INFO [RS:2;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,691 INFO [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 15:06:51,691 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:51,693 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59167832, jitterRate=-0.11833059787750244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 15:06:51,693 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 15:06:51,693 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 15:06:51,693 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 15:06:51,693 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 15:06:51,694 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 15:06:51,694 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 15:06:51,694 INFO [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 15:06:51,696 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 15:06:51,696 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 15:06:51,704 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 15:06:51,704 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-23 15:06:51,704 INFO [RS:2;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,704 INFO [RS:0;jenkins-hbase4:38883] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,704 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,704 INFO [RS:1;jenkins-hbase4:41023] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,705 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,704 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,705 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,705 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,705 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,705 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,706 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,706 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,706 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 15:06:51,706 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,706 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,706 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,705 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,706 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 15:06:51,706 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,706 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,707 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,707 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,707 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,707 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,707 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 15:06:51,707 DEBUG [RS:1;jenkins-hbase4:41023] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,707 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,707 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,707 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,707 DEBUG [RS:0;jenkins-hbase4:38883] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,706 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,715 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,715 DEBUG [RS:2;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 15:06:51,718 INFO [RS:0;jenkins-hbase4:38883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,728 INFO [RS:1;jenkins-hbase4:41023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,729 INFO [RS:0;jenkins-hbase4:38883] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,729 INFO [RS:1;jenkins-hbase4:41023] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,729 INFO [RS:0;jenkins-hbase4:38883] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,729 INFO [RS:1;jenkins-hbase4:41023] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,730 INFO [RS:2;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,730 INFO [RS:2;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,730 INFO [RS:2;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-23 15:06:51,780 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-23 15:06:51,783 INFO [RS:1;jenkins-hbase4:41023] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 15:06:51,784 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-23 15:06:51,784 INFO [RS:0;jenkins-hbase4:38883] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 15:06:51,786 INFO [RS:2;jenkins-hbase4:42581] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 15:06:51,794 INFO [RS:1;jenkins-hbase4:41023] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41023,1690124809736-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,794 INFO [RS:0;jenkins-hbase4:38883] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38883,1690124809666-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,798 INFO [RS:2;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42581,1690124809802-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:51,848 INFO [RS:2;jenkins-hbase4:42581] regionserver.Replication(203): jenkins-hbase4.apache.org,42581,1690124809802 started 2023-07-23 15:06:51,848 INFO [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42581,1690124809802, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42581, sessionid=0x10192b86f000003 2023-07-23 15:06:51,848 DEBUG [RS:2;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 15:06:51,848 DEBUG [RS:2;jenkins-hbase4:42581] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:51,848 DEBUG [RS:2;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42581,1690124809802' 2023-07-23 15:06:51,848 DEBUG [RS:2;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 15:06:51,849 DEBUG [RS:2;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 15:06:51,850 DEBUG [RS:2;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 15:06:51,850 DEBUG [RS:2;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 15:06:51,850 DEBUG [RS:2;jenkins-hbase4:42581] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:51,850 DEBUG [RS:2;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42581,1690124809802' 2023-07-23 15:06:51,850 DEBUG [RS:2;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:06:51,850 INFO [RS:0;jenkins-hbase4:38883] regionserver.Replication(203): jenkins-hbase4.apache.org,38883,1690124809666 started 2023-07-23 15:06:51,851 DEBUG [RS:2;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:06:51,851 INFO [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38883,1690124809666, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38883, sessionid=0x10192b86f000001 2023-07-23 15:06:51,851 DEBUG [RS:0;jenkins-hbase4:38883] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 15:06:51,851 DEBUG [RS:0;jenkins-hbase4:38883] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:06:51,852 DEBUG [RS:0;jenkins-hbase4:38883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38883,1690124809666' 2023-07-23 15:06:51,852 DEBUG [RS:0;jenkins-hbase4:38883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 15:06:51,859 INFO [RS:1;jenkins-hbase4:41023] regionserver.Replication(203): jenkins-hbase4.apache.org,41023,1690124809736 started 2023-07-23 15:06:51,859 DEBUG [RS:0;jenkins-hbase4:38883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 15:06:51,859 DEBUG [RS:2;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 15:06:51,859 INFO [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41023,1690124809736, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41023, sessionid=0x10192b86f000002 2023-07-23 15:06:51,859 INFO [RS:2;jenkins-hbase4:42581] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 15:06:51,860 DEBUG [RS:1;jenkins-hbase4:41023] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 15:06:51,860 INFO [RS:2;jenkins-hbase4:42581] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 15:06:51,860 DEBUG [RS:0;jenkins-hbase4:38883] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 15:06:51,860 DEBUG [RS:1;jenkins-hbase4:41023] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:51,860 DEBUG [RS:0;jenkins-hbase4:38883] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 15:06:51,861 DEBUG [RS:1;jenkins-hbase4:41023] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41023,1690124809736' 2023-07-23 15:06:51,861 DEBUG [RS:1;jenkins-hbase4:41023] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 15:06:51,861 DEBUG [RS:0;jenkins-hbase4:38883] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:06:51,862 DEBUG [RS:0;jenkins-hbase4:38883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38883,1690124809666' 2023-07-23 15:06:51,862 DEBUG [RS:0;jenkins-hbase4:38883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:06:51,862 DEBUG [RS:1;jenkins-hbase4:41023] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 15:06:51,862 DEBUG [RS:0;jenkins-hbase4:38883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:06:51,863 DEBUG [RS:1;jenkins-hbase4:41023] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 15:06:51,863 DEBUG [RS:1;jenkins-hbase4:41023] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 15:06:51,863 DEBUG [RS:1;jenkins-hbase4:41023] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:51,863 DEBUG [RS:1;jenkins-hbase4:41023] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41023,1690124809736' 2023-07-23 15:06:51,863 DEBUG [RS:1;jenkins-hbase4:41023] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:06:51,864 DEBUG [RS:1;jenkins-hbase4:41023] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:06:51,865 DEBUG [RS:1;jenkins-hbase4:41023] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 15:06:51,865 INFO [RS:1;jenkins-hbase4:41023] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 15:06:51,865 INFO [RS:1;jenkins-hbase4:41023] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 15:06:51,867 DEBUG [RS:0;jenkins-hbase4:38883] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 15:06:51,867 INFO [RS:0;jenkins-hbase4:38883] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 15:06:51,867 INFO [RS:0;jenkins-hbase4:38883] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 15:06:51,943 DEBUG [jenkins-hbase4:37385] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-23 15:06:51,947 DEBUG [jenkins-hbase4:37385] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:06:51,953 DEBUG [jenkins-hbase4:37385] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:06:51,953 DEBUG [jenkins-hbase4:37385] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:06:51,953 DEBUG [jenkins-hbase4:37385] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:06:51,953 DEBUG [jenkins-hbase4:37385] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:06:51,956 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38883,1690124809666, state=OPENING 2023-07-23 15:06:51,964 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-23 15:06:51,965 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:51,966 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 15:06:51,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:06:51,972 INFO [RS:0;jenkins-hbase4:38883] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38883%2C1690124809666, suffix=, logDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,38883,1690124809666, archiveDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/oldWALs, maxLogs=32 2023-07-23 15:06:51,972 INFO [RS:1;jenkins-hbase4:41023] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41023%2C1690124809736, suffix=, logDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,41023,1690124809736, archiveDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/oldWALs, maxLogs=32 2023-07-23 15:06:51,974 INFO [RS:2;jenkins-hbase4:42581] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42581%2C1690124809802, suffix=, logDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,42581,1690124809802, archiveDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/oldWALs, maxLogs=32 2023-07-23 15:06:52,007 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK] 2023-07-23 15:06:52,013 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK] 2023-07-23 15:06:52,019 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK] 2023-07-23 15:06:52,024 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK] 2023-07-23 15:06:52,024 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK] 2023-07-23 15:06:52,030 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK] 2023-07-23 15:06:52,032 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK] 2023-07-23 15:06:52,033 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK] 2023-07-23 15:06:52,033 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK] 2023-07-23 15:06:52,040 INFO [RS:0;jenkins-hbase4:38883] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,38883,1690124809666/jenkins-hbase4.apache.org%2C38883%2C1690124809666.1690124811978 2023-07-23 15:06:52,040 INFO [RS:2;jenkins-hbase4:42581] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,42581,1690124809802/jenkins-hbase4.apache.org%2C42581%2C1690124809802.1690124811978 2023-07-23 15:06:52,040 INFO [RS:1;jenkins-hbase4:41023] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,41023,1690124809736/jenkins-hbase4.apache.org%2C41023%2C1690124809736.1690124811978 2023-07-23 15:06:52,046 DEBUG [RS:0;jenkins-hbase4:38883] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK], DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK], DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK]] 2023-07-23 15:06:52,049 DEBUG [RS:1;jenkins-hbase4:41023] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK], DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK], DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK]] 2023-07-23 15:06:52,049 DEBUG [RS:2;jenkins-hbase4:42581] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK], DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK], DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK]] 2023-07-23 15:06:52,176 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:06:52,179 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:06:52,182 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:06:52,198 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-23 15:06:52,199 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 15:06:52,203 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38883%2C1690124809666.meta, suffix=.meta, logDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,38883,1690124809666, archiveDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/oldWALs, maxLogs=32 2023-07-23 15:06:52,225 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK] 2023-07-23 15:06:52,232 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK] 2023-07-23 15:06:52,233 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK] 2023-07-23 15:06:52,255 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/WALs/jenkins-hbase4.apache.org,38883,1690124809666/jenkins-hbase4.apache.org%2C38883%2C1690124809666.meta.1690124812205.meta 2023-07-23 15:06:52,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39765,DS-ebe33f19-5712-40a8-bb62-77779fdd5a25,DISK], DatanodeInfoWithStorage[127.0.0.1:44243,DS-ece8b966-f9dd-4808-b155-42b476a96379,DISK], DatanodeInfoWithStorage[127.0.0.1:41123,DS-d5be584c-8d53-483b-8eca-d81233a3c962,DISK]] 2023-07-23 15:06:52,256 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:06:52,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-23 15:06:52,260 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:52,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-23 15:06:52,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-23 15:06:52,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-23 15:06:52,289 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-23 15:06:52,289 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:52,289 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-23 15:06:52,289 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-23 15:06:52,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 15:06:52,295 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/info 2023-07-23 15:06:52,295 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/info 2023-07-23 15:06:52,296 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 15:06:52,297 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:52,297 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 15:06:52,299 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/rep_barrier 2023-07-23 15:06:52,299 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/rep_barrier 2023-07-23 15:06:52,300 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 15:06:52,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:52,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 15:06:52,303 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/table 2023-07-23 15:06:52,303 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/table 2023-07-23 15:06:52,304 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 15:06:52,305 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:52,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740 2023-07-23 15:06:52,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740 2023-07-23 15:06:52,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 15:06:52,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 15:06:52,321 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67184931, jitterRate=0.0011334866285324097}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 15:06:52,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 15:06:52,337 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690124812163 2023-07-23 15:06:52,360 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-23 15:06:52,361 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38883,1690124809666, state=OPEN 2023-07-23 15:06:52,363 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-23 15:06:52,364 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-23 15:06:52,364 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 15:06:52,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-23 15:06:52,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38883,1690124809666 in 393 msec 2023-07-23 15:06:52,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-23 15:06:52,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 631 msec 2023-07-23 15:06:52,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1600 sec 2023-07-23 15:06:52,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690124812390, completionTime=-1 2023-07-23 15:06:52,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-23 15:06:52,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-23 15:06:52,474 DEBUG [hconnection-0x5e5ee97d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:06:52,477 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:06:52,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-23 15:06:52,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690124872507 2023-07-23 15:06:52,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690124932507 2023-07-23 15:06:52,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 116 msec 2023-07-23 15:06:52,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37385,1690124808099-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37385,1690124808099-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37385,1690124808099-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37385, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-23 15:06:52,540 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-23 15:06:52,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-23 15:06:52,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 15:06:52,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-23 15:06:52,567 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:06:52,571 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:06:52,596 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:06:52,601 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022 empty. 2023-07-23 15:06:52,602 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:06:52,602 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-23 15:06:52,650 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:52,653 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5bfd8885fc18777b8a92ffb83a412022, NAME => 'hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:06:52,673 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:52,673 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5bfd8885fc18777b8a92ffb83a412022, disabling compactions & flushes 2023-07-23 15:06:52,673 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:06:52,673 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:06:52,673 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. after waiting 0 ms 2023-07-23 15:06:52,674 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:06:52,674 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:06:52,674 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5bfd8885fc18777b8a92ffb83a412022: 2023-07-23 15:06:52,679 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:06:52,702 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690124812684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124812684"}]},"ts":"1690124812684"} 2023-07-23 15:06:52,735 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 15:06:52,737 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:06:52,741 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124812737"}]},"ts":"1690124812737"} 2023-07-23 15:06:52,747 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-23 15:06:52,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:06:52,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:06:52,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:06:52,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:06:52,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:06:52,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5bfd8885fc18777b8a92ffb83a412022, ASSIGN}] 2023-07-23 15:06:52,759 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5bfd8885fc18777b8a92ffb83a412022, ASSIGN 2023-07-23 15:06:52,761 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5bfd8885fc18777b8a92ffb83a412022, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1690124809802; forceNewPlan=false, retain=false 2023-07-23 15:06:52,914 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 15:06:52,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5bfd8885fc18777b8a92ffb83a412022, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:52,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690124812915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124812915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124812915"}]},"ts":"1690124812915"} 2023-07-23 15:06:52,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5bfd8885fc18777b8a92ffb83a412022, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:06:53,077 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:53,078 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:06:53,081 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:06:53,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:06:53,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5bfd8885fc18777b8a92ffb83a412022, NAME => 'hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022.', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:06:53,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. service=AccessControlService 2023-07-23 15:06:53,090 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:53,091 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:06:53,091 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:53,091 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:06:53,091 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:06:53,094 INFO [StoreOpener-5bfd8885fc18777b8a92ffb83a412022-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:06:53,097 DEBUG [StoreOpener-5bfd8885fc18777b8a92ffb83a412022-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022/info 2023-07-23 15:06:53,097 DEBUG [StoreOpener-5bfd8885fc18777b8a92ffb83a412022-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022/info 2023-07-23 15:06:53,098 INFO [StoreOpener-5bfd8885fc18777b8a92ffb83a412022-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5bfd8885fc18777b8a92ffb83a412022 columnFamilyName info 2023-07-23 15:06:53,099 INFO [StoreOpener-5bfd8885fc18777b8a92ffb83a412022-1] regionserver.HStore(310): Store=5bfd8885fc18777b8a92ffb83a412022/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:53,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:06:53,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:06:53,107 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:06:53,111 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:53,112 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5bfd8885fc18777b8a92ffb83a412022; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71793242, jitterRate=0.0698026716709137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:53,112 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5bfd8885fc18777b8a92ffb83a412022: 2023-07-23 15:06:53,114 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022., pid=6, masterSystemTime=1690124813077 2023-07-23 15:06:53,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:06:53,120 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:06:53,122 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5bfd8885fc18777b8a92ffb83a412022, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:53,122 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690124813121"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124813121"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124813121"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124813121"}]},"ts":"1690124813121"} 2023-07-23 15:06:53,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-23 15:06:53,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5bfd8885fc18777b8a92ffb83a412022, server=jenkins-hbase4.apache.org,42581,1690124809802 in 204 msec 2023-07-23 15:06:53,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-23 15:06:53,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5bfd8885fc18777b8a92ffb83a412022, ASSIGN in 375 msec 2023-07-23 15:06:53,136 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:06:53,136 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124813136"}]},"ts":"1690124813136"} 2023-07-23 15:06:53,139 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-23 15:06:53,143 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:06:53,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 589 msec 2023-07-23 15:06:53,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-23 15:06:53,169 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-23 15:06:53,170 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:53,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:06:53,194 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:06:53,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-23 15:06:53,226 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 15:06:53,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-23 15:06:53,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-23 15:06:53,254 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 15:06:53,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-23 15:06:53,268 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-23 15:06:53,272 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-23 15:06:53,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.391sec 2023-07-23 15:06:53,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-23 15:06:53,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-23 15:06:53,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-23 15:06:53,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37385,1690124808099-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-23 15:06:53,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37385,1690124808099-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-23 15:06:53,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 15:06:53,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-23 15:06:53,307 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:06:53,310 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:06:53,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-23 15:06:53,313 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:06:53,314 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd empty. 2023-07-23 15:06:53,317 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:06:53,317 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-23 15:06:53,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 15:06:53,350 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:53,353 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => abe59583370c1eb91b86f9bbce69f6cd, NAME => 'hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:06:53,355 DEBUG [Listener at localhost/45147] zookeeper.ReadOnlyZKClient(139): Connect 0x7bd08a84 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:06:53,372 DEBUG [Listener at localhost/45147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71ba7b55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:06:53,396 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:53,397 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing abe59583370c1eb91b86f9bbce69f6cd, disabling compactions & flushes 2023-07-23 15:06:53,397 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:06:53,397 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:06:53,397 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. after waiting 0 ms 2023-07-23 15:06:53,397 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:06:53,397 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:06:53,397 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for abe59583370c1eb91b86f9bbce69f6cd: 2023-07-23 15:06:53,407 DEBUG [hconnection-0x68fcc5d6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:06:53,407 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:06:53,409 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690124813408"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124813408"}]},"ts":"1690124813408"} 2023-07-23 15:06:53,413 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 15:06:53,414 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:06:53,415 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124813415"}]},"ts":"1690124813415"} 2023-07-23 15:06:53,423 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:06:53,423 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-23 15:06:53,425 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/test.cache.data in system properties and HBase conf 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop.log.dir in system properties and HBase conf 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 15:06:53,426 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 15:06:53,427 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 15:06:53,427 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 15:06:53,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 15:06:53,427 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 15:06:53,427 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 15:06:53,427 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/nfs.dump.dir in system properties and HBase conf 2023-07-23 15:06:53,427 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir in system properties and HBase conf 2023-07-23 15:06:53,427 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 15:06:53,427 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 15:06:53,427 INFO [Listener at localhost/45147] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-23 15:06:53,431 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:06:53,432 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:06:53,432 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:06:53,432 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:06:53,433 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:06:53,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=abe59583370c1eb91b86f9bbce69f6cd, ASSIGN}] 2023-07-23 15:06:53,436 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=abe59583370c1eb91b86f9bbce69f6cd, ASSIGN 2023-07-23 15:06:53,437 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=abe59583370c1eb91b86f9bbce69f6cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41023,1690124809736; forceNewPlan=false, retain=false 2023-07-23 15:06:53,588 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 15:06:53,588 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=abe59583370c1eb91b86f9bbce69f6cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:53,589 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690124813588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124813588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124813588"}]},"ts":"1690124813588"} 2023-07-23 15:06:53,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure abe59583370c1eb91b86f9bbce69f6cd, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:06:53,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 15:06:53,750 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:53,750 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:06:53,758 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:06:53,767 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:06:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => abe59583370c1eb91b86f9bbce69f6cd, NAME => 'hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd.', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:06:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. service=AccessControlService 2023-07-23 15:06:53,777 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:53,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:06:53,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:53,781 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:06:53,781 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:06:53,801 INFO [StoreOpener-abe59583370c1eb91b86f9bbce69f6cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:06:53,806 DEBUG [StoreOpener-abe59583370c1eb91b86f9bbce69f6cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd/l 2023-07-23 15:06:53,807 DEBUG [StoreOpener-abe59583370c1eb91b86f9bbce69f6cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd/l 2023-07-23 15:06:53,808 INFO [StoreOpener-abe59583370c1eb91b86f9bbce69f6cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abe59583370c1eb91b86f9bbce69f6cd columnFamilyName l 2023-07-23 15:06:53,811 INFO [StoreOpener-abe59583370c1eb91b86f9bbce69f6cd-1] regionserver.HStore(310): Store=abe59583370c1eb91b86f9bbce69f6cd/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:53,813 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:06:53,815 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:06:53,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:06:53,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:53,836 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened abe59583370c1eb91b86f9bbce69f6cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73573091, jitterRate=0.09632448852062225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:53,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for abe59583370c1eb91b86f9bbce69f6cd: 2023-07-23 15:06:53,840 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd., pid=11, masterSystemTime=1690124813750 2023-07-23 15:06:53,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:06:53,848 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=abe59583370c1eb91b86f9bbce69f6cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:53,848 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690124813848"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124813848"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124813848"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124813848"}]},"ts":"1690124813848"} 2023-07-23 15:06:53,855 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:06:53,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-23 15:06:53,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure abe59583370c1eb91b86f9bbce69f6cd, server=jenkins-hbase4.apache.org,41023,1690124809736 in 260 msec 2023-07-23 15:06:53,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-23 15:06:53,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=abe59583370c1eb91b86f9bbce69f6cd, ASSIGN in 428 msec 2023-07-23 15:06:53,868 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:06:53,868 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124813868"}]},"ts":"1690124813868"} 2023-07-23 15:06:53,871 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-23 15:06:53,875 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:06:53,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 573 msec 2023-07-23 15:06:53,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 15:06:53,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-23 15:06:53,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-23 15:06:54,837 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:55,141 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:55,147 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35913_jobhistory____.veu332/webapp 2023-07-23 15:06:55,300 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-23 15:06:55,300 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-23 15:06:55,300 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 15:06:55,302 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 15:06:55,367 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:55,625 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:56,000 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-23 15:06:56,051 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35913 2023-07-23 15:06:56,350 WARN [Listener at jenkins-hbase4.apache.org/39827] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:56,782 WARN [Listener at jenkins-hbase4.apache.org/39827] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 15:06:56,782 INFO [Listener at jenkins-hbase4.apache.org/39827] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:56,793 INFO [Listener at jenkins-hbase4.apache.org/39827] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44249_cluster____.ldkrjn/webapp 2023-07-23 15:06:56,895 INFO [Listener at jenkins-hbase4.apache.org/39827] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 15:06:56,895 INFO [Listener at jenkins-hbase4.apache.org/39827] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-23 15:06:56,896 INFO [Listener at jenkins-hbase4.apache.org/39827] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 15:06:56,897 INFO [Listener at jenkins-hbase4.apache.org/39827] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 15:06:56,909 INFO [Listener at jenkins-hbase4.apache.org/39827] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:57,332 INFO [Listener at jenkins-hbase4.apache.org/39827] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:57,576 INFO [Listener at jenkins-hbase4.apache.org/39827] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:57,585 INFO [Listener at jenkins-hbase4.apache.org/39827] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44249 2023-07-23 15:06:57,958 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:06:58,149 WARN [Listener at jenkins-hbase4.apache.org/40993] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:58,169 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-23 15:06:58,171 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-23 15:06:58,172 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-23 15:06:58,187 WARN [Listener at jenkins-hbase4.apache.org/40993] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 15:06:58,187 INFO [Listener at jenkins-hbase4.apache.org/40993] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:58,197 INFO [Listener at jenkins-hbase4.apache.org/40993] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44495_node____.t3rgfm/webapp 2023-07-23 15:06:58,268 INFO [Listener at jenkins-hbase4.apache.org/40993] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 15:06:58,269 INFO [Listener at jenkins-hbase4.apache.org/40993] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 15:06:58,270 INFO [Listener at jenkins-hbase4.apache.org/40993] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 15:06:58,270 INFO [Listener at jenkins-hbase4.apache.org/40993] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 15:06:58,286 INFO [Listener at jenkins-hbase4.apache.org/40993] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,321 INFO [Listener at jenkins-hbase4.apache.org/40993] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,342 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:06:58,342 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-23 15:06:58,343 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:06:58,343 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-23 15:06:58,343 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 15:06:58,343 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-23 15:06:58,344 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:06:58,344 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-23 15:06:58,344 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 15:06:58,344 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-23 15:06:58,414 INFO [Listener at jenkins-hbase4.apache.org/40993] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,427 INFO [Listener at jenkins-hbase4.apache.org/40993] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44495 2023-07-23 15:06:58,691 WARN [Listener at jenkins-hbase4.apache.org/42857] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 15:06:58,698 WARN [Listener at jenkins-hbase4.apache.org/42857] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 15:06:58,699 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 15:06:58,708 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34877_node____golmj9/webapp 2023-07-23 15:06:58,776 INFO [Listener at jenkins-hbase4.apache.org/42857] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 15:06:58,777 INFO [Listener at jenkins-hbase4.apache.org/42857] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 15:06:58,777 INFO [Listener at jenkins-hbase4.apache.org/42857] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 15:06:58,777 INFO [Listener at jenkins-hbase4.apache.org/42857] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 15:06:58,783 INFO [Listener at jenkins-hbase4.apache.org/42857] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,803 INFO [Listener at jenkins-hbase4.apache.org/42857] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,877 INFO [Listener at jenkins-hbase4.apache.org/42857] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 15:06:58,887 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34877 2023-07-23 15:06:58,917 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-23 15:06:58,919 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:06:58,988 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=111, ProcessCount=173, AvailableMemoryMB=8328 2023-07-23 15:06:58,988 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-23 15:06:59,006 DEBUG [Listener at jenkins-hbase4.apache.org/42857] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-23 15:06:59,015 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-23 15:06:59,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 15:06:59,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:06:59,029 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:06:59,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-23 15:06:59,032 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:06:59,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:06:59,039 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:06:59,043 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf empty. 2023-07-23 15:06:59,043 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb 2023-07-23 15:06:59,046 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:06:59,047 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb empty. 2023-07-23 15:06:59,048 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb 2023-07-23 15:06:59,048 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 15:06:59,087 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-23 15:06:59,091 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => f1886eabdbf74e7807083d912991ebaf, NAME => 'testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:06:59,101 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 382b7c50824348996606d941d75dcfdb, NAME => 'testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:06:59,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:06:59,154 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:59,162 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing f1886eabdbf74e7807083d912991ebaf, disabling compactions & flushes 2023-07-23 15:06:59,162 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:06:59,162 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:06:59,162 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. after waiting 0 ms 2023-07-23 15:06:59,162 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:06:59,162 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:06:59,162 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for f1886eabdbf74e7807083d912991ebaf: 2023-07-23 15:06:59,163 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:59,163 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 382b7c50824348996606d941d75dcfdb, disabling compactions & flushes 2023-07-23 15:06:59,163 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:06:59,163 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:06:59,163 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. after waiting 0 ms 2023-07-23 15:06:59,163 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:06:59,163 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:06:59,163 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 382b7c50824348996606d941d75dcfdb: 2023-07-23 15:06:59,168 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:06:59,169 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819169"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124819169"}]},"ts":"1690124819169"} 2023-07-23 15:06:59,169 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819169"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124819169"}]},"ts":"1690124819169"} 2023-07-23 15:06:59,221 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:06:59,222 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:06:59,222 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124819222"}]},"ts":"1690124819222"} 2023-07-23 15:06:59,227 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-23 15:06:59,232 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:06:59,234 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:06:59,234 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:06:59,234 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:06:59,234 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:06:59,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1886eabdbf74e7807083d912991ebaf, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=382b7c50824348996606d941d75dcfdb, ASSIGN}] 2023-07-23 15:06:59,238 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=382b7c50824348996606d941d75dcfdb, ASSIGN 2023-07-23 15:06:59,238 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1886eabdbf74e7807083d912991ebaf, ASSIGN 2023-07-23 15:06:59,239 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=382b7c50824348996606d941d75dcfdb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1690124809802; forceNewPlan=false, retain=false 2023-07-23 15:06:59,239 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1886eabdbf74e7807083d912991ebaf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41023,1690124809736; forceNewPlan=false, retain=false 2023-07-23 15:06:59,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:06:59,389 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:06:59,392 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f1886eabdbf74e7807083d912991ebaf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:59,392 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=382b7c50824348996606d941d75dcfdb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:59,393 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124819392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124819392"}]},"ts":"1690124819392"} 2023-07-23 15:06:59,393 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124819392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124819392"}]},"ts":"1690124819392"} 2023-07-23 15:06:59,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure f1886eabdbf74e7807083d912991ebaf, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:06:59,398 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 382b7c50824348996606d941d75dcfdb, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:06:59,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:06:59,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1886eabdbf74e7807083d912991ebaf, NAME => 'testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:06:59,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. service=AccessControlService 2023-07-23 15:06:59,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:59,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:06:59,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:59,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:06:59,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:06:59,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:06:59,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 382b7c50824348996606d941d75dcfdb, NAME => 'testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:06:59,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. service=AccessControlService 2023-07-23 15:06:59,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:06:59,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 382b7c50824348996606d941d75dcfdb 2023-07-23 15:06:59,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:06:59,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 382b7c50824348996606d941d75dcfdb 2023-07-23 15:06:59,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 382b7c50824348996606d941d75dcfdb 2023-07-23 15:06:59,563 INFO [StoreOpener-382b7c50824348996606d941d75dcfdb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 382b7c50824348996606d941d75dcfdb 2023-07-23 15:06:59,563 INFO [StoreOpener-f1886eabdbf74e7807083d912991ebaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:06:59,565 DEBUG [StoreOpener-382b7c50824348996606d941d75dcfdb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/cf 2023-07-23 15:06:59,565 DEBUG [StoreOpener-382b7c50824348996606d941d75dcfdb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/cf 2023-07-23 15:06:59,566 DEBUG [StoreOpener-f1886eabdbf74e7807083d912991ebaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/cf 2023-07-23 15:06:59,566 DEBUG [StoreOpener-f1886eabdbf74e7807083d912991ebaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/cf 2023-07-23 15:06:59,569 INFO [StoreOpener-382b7c50824348996606d941d75dcfdb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 382b7c50824348996606d941d75dcfdb columnFamilyName cf 2023-07-23 15:06:59,569 INFO [StoreOpener-f1886eabdbf74e7807083d912991ebaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1886eabdbf74e7807083d912991ebaf columnFamilyName cf 2023-07-23 15:06:59,573 INFO [StoreOpener-382b7c50824348996606d941d75dcfdb-1] regionserver.HStore(310): Store=382b7c50824348996606d941d75dcfdb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:59,573 INFO [StoreOpener-f1886eabdbf74e7807083d912991ebaf-1] regionserver.HStore(310): Store=f1886eabdbf74e7807083d912991ebaf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:06:59,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:06:59,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb 2023-07-23 15:06:59,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:06:59,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb 2023-07-23 15:06:59,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:06:59,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 382b7c50824348996606d941d75dcfdb 2023-07-23 15:06:59,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:59,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:06:59,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 382b7c50824348996606d941d75dcfdb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72372769, jitterRate=0.07843829691410065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:59,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f1886eabdbf74e7807083d912991ebaf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63635816, jitterRate=-0.051752448081970215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:06:59,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 382b7c50824348996606d941d75dcfdb: 2023-07-23 15:06:59,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f1886eabdbf74e7807083d912991ebaf: 2023-07-23 15:06:59,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb., pid=16, masterSystemTime=1690124819550 2023-07-23 15:06:59,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf., pid=15, masterSystemTime=1690124819549 2023-07-23 15:06:59,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:06:59,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:06:59,595 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=382b7c50824348996606d941d75dcfdb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:06:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:06:59,596 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124819595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124819595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124819595"}]},"ts":"1690124819595"} 2023-07-23 15:06:59,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:06:59,597 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f1886eabdbf74e7807083d912991ebaf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:06:59,600 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124819597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124819597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124819597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124819597"}]},"ts":"1690124819597"} 2023-07-23 15:06:59,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-23 15:06:59,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 382b7c50824348996606d941d75dcfdb, server=jenkins-hbase4.apache.org,42581,1690124809802 in 205 msec 2023-07-23 15:06:59,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-23 15:06:59,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure f1886eabdbf74e7807083d912991ebaf, server=jenkins-hbase4.apache.org,41023,1690124809736 in 209 msec 2023-07-23 15:06:59,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=382b7c50824348996606d941d75dcfdb, ASSIGN in 373 msec 2023-07-23 15:06:59,613 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-23 15:06:59,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1886eabdbf74e7807083d912991ebaf, ASSIGN in 374 msec 2023-07-23 15:06:59,615 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:06:59,615 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124819615"}]},"ts":"1690124819615"} 2023-07-23 15:06:59,617 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-23 15:06:59,620 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:06:59,625 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-23 15:06:59,631 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:06:59,635 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:06:59,639 DEBUG [hconnection-0x5cf3e9a7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:06:59,642 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-23 15:06:59,650 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 15:06:59,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:06:59,683 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 15:06:59,683 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 15:06:59,683 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 15:06:59,683 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 15:06:59,683 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:06:59,690 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 15:06:59,690 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 15:06:59,690 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 15:06:59,690 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 15:06:59,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 667 msec 2023-07-23 15:07:00,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 15:07:00,168 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-23 15:07:00,175 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 15:07:00,176 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:00,179 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:00,207 DEBUG [hconnection-0x68fcc5d6-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,211 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,216 DEBUG [hconnection-0x68fcc5d6-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,222 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:00,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124820254 (current time:1690124820254). 2023-07-23 15:07:00,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:00,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x6c5fb9b5 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:00,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fb020ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:00,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,267 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c5fb9b5 to 127.0.0.1:63816 2023-07-23 15:07:00,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:00,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x53fbfe09 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:00,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78529609, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:00,284 DEBUG [hconnection-0x22c52673-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,285 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:00,293 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:00,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53fbfe09 to 127.0.0.1:63816 2023-07-23 15:07:00,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:00,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 15:07:00,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:00,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:00,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:00,352 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:00,354 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690125420354 2023-07-23 15:07:00,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:00,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 15:07:00,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:00,372 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:00,374 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:00,374 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:00,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 31 msec 2023-07-23 15:07:00,376 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:00,377 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690125420377 2023-07-23 15:07:00,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,411 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-23 15:07:00,411 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,412 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 15:07:00,412 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 15:07:00,415 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,415 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,419 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,419 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,419 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,420 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,421 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,421 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,422 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 15:07:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,424 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:00,424 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:00,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:00,430 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:00,430 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:00,430 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:00,433 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,433 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,434 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:00,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 15:07:00,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@602fd638[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:00,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 15:07:00,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@602fd638[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:00,441 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 15:07:00,441 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,446 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:00,447 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:00,447 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:00,447 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:07:00,447 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,447 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,448 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:00,448 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:00,448 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:00,448 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:00,448 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:00,448 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:00,461 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:07:00,461 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:00,461 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:00,461 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:00,462 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. started... 2023-07-23 15:07:00,462 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. started... 2023-07-23 15:07:00,466 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 382b7c50824348996606d941d75dcfdb: 2023-07-23 15:07:00,466 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1886eabdbf74e7807083d912991ebaf: 2023-07-23 15:07:00,467 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,467 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,474 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:00,475 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:00,475 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:00,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:00,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:00,481 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:00,482 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:00,482 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:00,540 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. completed. 2023-07-23 15:07:00,541 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:07:00,542 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:00,542 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:00,542 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,542 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:00,542 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:07:00,542 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. completed. 2023-07-23 15:07:00,542 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:00,542 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:00,543 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:00,543 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,543 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:00,543 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:07:00,545 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:00,545 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,545 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:00,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,546 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:00,546 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:00,545 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:00,546 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,546 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:00,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42581,1690124809802': 2023-07-23 15:07:00,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 15:07:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:07:00,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 15:07:00,560 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-23 15:07:00,560 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:00,560 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:00,560 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,560 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:00,566 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,566 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,566 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,566 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,566 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,566 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,567 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,568 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,568 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,569 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:00,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,572 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:00,572 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,573 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,587 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,587 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,588 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,588 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,587 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:00,588 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,588 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,588 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,588 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:00,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,590 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:00,590 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,591 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:00,591 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,591 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:00,591 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:00,591 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:00,591 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:00,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-23 15:07:00,592 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,592 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:07:00,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 15:07:00,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,681 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:00,683 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:07:00,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 15:07:00,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,728 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:00,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690124820358Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690124820614 (+256 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690124820614Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690124820614Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690124820630 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690124820657 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690124820727 (+70 ms) 2023-07-23 15:07:00,731 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:00,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 371 msec 2023-07-23 15:07:00,983 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:00,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:00,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:01,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41023] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:01,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:01,009 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 15:07:01,009 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:01,009 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:01,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:01,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124821026 (current time:1690124821026). 2023-07-23 15:07:01,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:01,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x7a0a6ee0 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:01,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54d6ef7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:01,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:01,055 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:01,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a0a6ee0 to 127.0.0.1:63816 2023-07-23 15:07:01,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:01,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x50d45ad6 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:01,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79805342, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:01,082 DEBUG [hconnection-0x17d4a053-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:01,085 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:01,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:01,091 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:01,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50d45ad6 to 127.0.0.1:63816 2023-07-23 15:07:01,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:01,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 15:07:01,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:01,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:01,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:01,097 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:01,098 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690125421098 2023-07-23 15:07:01,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 15:07:01,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 15:07:01,099 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:01,100 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:01,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:01,101 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 15:07:01,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-23 15:07:01,103 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:01,104 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690125421104 2023-07-23 15:07:01,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-23 15:07:01,119 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-23 15:07:01,119 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:01,120 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 15:07:01,120 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 15:07:01,120 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,120 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,123 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:01,123 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:01,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:01,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:01,123 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,123 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:01,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:01,124 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,124 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,124 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,124 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:01,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 15:07:01,125 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:01,125 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:01,125 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:01,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 15:07:01,126 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:01,126 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 15:07:01,125 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:01,126 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:01,127 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 15:07:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:01,126 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 15:07:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 15:07:01,130 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,130 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:01,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:01,131 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:01,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:01,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:01,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 15:07:01,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@110ee89c[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:01,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:01,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:01,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 15:07:01,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@110ee89c[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:01,136 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 15:07:01,136 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,142 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,142 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,142 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,142 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:01,142 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:01,142 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:01,142 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:07:01,142 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,143 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:01,142 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:01,143 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. started... 2023-07-23 15:07:01,143 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,143 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:01,143 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 15:07:01,143 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:01,143 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f1886eabdbf74e7807083d912991ebaf 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 15:07:01,143 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:07:01,143 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:01,143 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. started... 2023-07-23 15:07:01,143 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:01,143 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 382b7c50824348996606d941d75dcfdb 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 15:07:01,145 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:01,145 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:01,145 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:01,200 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:01,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:01,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:01,202 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:01,281 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072379b8ac7eeae44583a3fd019993c8bf52 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072379b8ac7eeae44583a3fd019993c8bf52 2023-07-23 15:07:01,281 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723ae6580bed9b44a9ebf7f92527a9a0164 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723ae6580bed9b44a9ebf7f92527a9a0164 2023-07-23 15:07:01,307 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/.tmp/cf/2dd11cd0abbd4537a618295a6b325c53 2023-07-23 15:07:01,309 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/.tmp/cf/f582675255f34e89a3784e4a6dadd1e0 2023-07-23 15:07:01,319 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/.tmp/cf/f582675255f34e89a3784e4a6dadd1e0 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/cf/f582675255f34e89a3784e4a6dadd1e0 2023-07-23 15:07:01,319 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/.tmp/cf/2dd11cd0abbd4537a618295a6b325c53 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/cf/2dd11cd0abbd4537a618295a6b325c53 2023-07-23 15:07:01,328 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/cf/f582675255f34e89a3784e4a6dadd1e0, entries=2, sequenceid=6, filesize=5.2 K 2023-07-23 15:07:01,329 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/cf/2dd11cd0abbd4537a618295a6b325c53, entries=48, sequenceid=6, filesize=13.0 K 2023-07-23 15:07:01,332 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for f1886eabdbf74e7807083d912991ebaf in 189ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:01,332 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 382b7c50824348996606d941d75dcfdb in 189ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:01,333 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 15:07:01,333 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 15:07:01,335 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 382b7c50824348996606d941d75dcfdb: 2023-07-23 15:07:01,335 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1886eabdbf74e7807083d912991ebaf: 2023-07-23 15:07:01,335 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 15:07:01,335 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 15:07:01,335 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:01,335 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:01,336 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/cf/2dd11cd0abbd4537a618295a6b325c53] hfiles 2023-07-23 15:07:01,336 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/cf/f582675255f34e89a3784e4a6dadd1e0] hfiles 2023-07-23 15:07:01,336 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/cf/2dd11cd0abbd4537a618295a6b325c53 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 15:07:01,336 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/cf/f582675255f34e89a3784e4a6dadd1e0 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 15:07:01,367 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. completed. 2023-07-23 15:07:01,367 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:07:01,367 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. completed. 2023-07-23 15:07:01,367 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,368 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:07:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 15:07:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:07:01,370 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:01,371 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 15:07:01,371 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:01,371 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:01,371 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:01,372 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 15:07:01,372 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,373 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:01,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42581,1690124809802': 2023-07-23 15:07:01,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 15:07:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:01,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:01,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:01,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:01,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:07:01,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 15:07:01,382 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-23 15:07:01,382 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:01,383 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:01,383 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-23 15:07:01,383 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:01,384 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,384 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,385 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,384 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,385 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:01,385 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,385 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,385 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:01,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,386 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,386 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,389 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:01,389 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 15:07:01,389 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,402 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:01,402 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,402 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:01,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:01,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:01,402 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,402 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:01,402 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:01,402 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:01,402 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:01,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:01,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-23 15:07:01,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:01,402 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:01,402 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:01,403 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,404 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,403 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-23 15:07:01,404 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 15:07:01,404 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:01,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:07:01,404 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,404 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:01,404 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:01,404 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,404 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:01,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:01,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:01,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:01,405 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:07:01,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072379b8ac7eeae44583a3fd019993c8bf52, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723ae6580bed9b44a9ebf7f92527a9a0164] mob files 2023-07-23 15:07:01,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072379b8ac7eeae44583a3fd019993c8bf52 2023-07-23 15:07:01,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723ae6580bed9b44a9ebf7f92527a9a0164 2023-07-23 15:07:01,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-23 15:07:01,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,529 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 15:07:01,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,530 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 15:07:01,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690124821099Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690124821418 (+319 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690124821418Loading Region manifests for snaptb0-testExportWithTargetName at 1690124821419 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1690124821429 (+10 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690124821455 (+26 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690124821529 (+74 ms) 2023-07-23 15:07:01,533 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 15:07:01,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 435 msec 2023-07-23 15:07:01,705 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:01,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 15:07:01,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:01,709 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709 2023-07-23 15:07:01,710 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44181, tgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709, rawTgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709, srcFsUri=hdfs://localhost:44181, srcDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:07:01,755 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:07:01,755 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2088149338_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 15:07:01,755 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661, snapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-23 15:07:01,774 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 15:07:02,240 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,241 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,241 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,242 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,242 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,243 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,243 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,319 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop-8831099884077916224.jar 2023-07-23 15:07:02,319 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,320 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,320 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,321 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,321 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,321 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:02,322 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:07:02,322 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:07:02,323 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:07:02,323 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:07:02,324 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:07:02,324 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:07:02,325 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:07:02,325 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:07:02,325 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:07:02,326 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:07:02,330 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:02,330 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:02,330 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:02,331 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:02,331 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:02,331 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:02,332 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:03,133 WARN [Listener at jenkins-hbase4.apache.org/42857] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:07:03,140 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-23 15:07:03,150 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-23 15:07:04,064 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:04,066 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:04,721 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:05,066 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:07:09,899 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:12,171 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:15,387 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:17,444 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:07:17,446 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:07:17,459 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-23 15:07:17,459 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:07:17,460 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:07:17,460 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 15:07:17,461 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-23 15:07:17,461 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-23 15:07:17,461 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709/.hbase-snapshot/testExportWithTargetName 2023-07-23 15:07:17,462 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-23 15:07:17,462 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124821709/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-23 15:07:17,473 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-23 15:07:17,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-23 15:07:17,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:17,493 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124837493"}]},"ts":"1690124837493"} 2023-07-23 15:07:17,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 15:07:17,495 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-23 15:07:17,497 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-23 15:07:17,498 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1886eabdbf74e7807083d912991ebaf, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=382b7c50824348996606d941d75dcfdb, UNASSIGN}] 2023-07-23 15:07:17,501 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1886eabdbf74e7807083d912991ebaf, UNASSIGN 2023-07-23 15:07:17,501 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=382b7c50824348996606d941d75dcfdb, UNASSIGN 2023-07-23 15:07:17,502 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f1886eabdbf74e7807083d912991ebaf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:17,502 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=382b7c50824348996606d941d75dcfdb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:17,502 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124837502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124837502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124837502"}]},"ts":"1690124837502"} 2023-07-23 15:07:17,502 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124837502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124837502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124837502"}]},"ts":"1690124837502"} 2023-07-23 15:07:17,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure f1886eabdbf74e7807083d912991ebaf, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:07:17,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 382b7c50824348996606d941d75dcfdb, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:07:17,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 15:07:17,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 382b7c50824348996606d941d75dcfdb 2023-07-23 15:07:17,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:07:17,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 382b7c50824348996606d941d75dcfdb, disabling compactions & flushes 2023-07-23 15:07:17,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f1886eabdbf74e7807083d912991ebaf, disabling compactions & flushes 2023-07-23 15:07:17,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:07:17,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:17,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:07:17,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:17,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. after waiting 0 ms 2023-07-23 15:07:17,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. after waiting 0 ms 2023-07-23 15:07:17,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:17,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:07:17,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:07:17,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:07:17,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:07:17,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb. 2023-07-23 15:07:17,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 382b7c50824348996606d941d75dcfdb: 2023-07-23 15:07:17,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:07:17,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf. 2023-07-23 15:07:17,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f1886eabdbf74e7807083d912991ebaf: 2023-07-23 15:07:17,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 382b7c50824348996606d941d75dcfdb 2023-07-23 15:07:17,714 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=382b7c50824348996606d941d75dcfdb, regionState=CLOSED 2023-07-23 15:07:17,714 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124837714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124837714"}]},"ts":"1690124837714"} 2023-07-23 15:07:17,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:07:17,720 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f1886eabdbf74e7807083d912991ebaf, regionState=CLOSED 2023-07-23 15:07:17,720 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690124837720"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124837720"}]},"ts":"1690124837720"} 2023-07-23 15:07:17,723 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-23 15:07:17,723 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 382b7c50824348996606d941d75dcfdb, server=jenkins-hbase4.apache.org,42581,1690124809802 in 212 msec 2023-07-23 15:07:17,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=382b7c50824348996606d941d75dcfdb, UNASSIGN in 226 msec 2023-07-23 15:07:17,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-23 15:07:17,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure f1886eabdbf74e7807083d912991ebaf, server=jenkins-hbase4.apache.org,41023,1690124809736 in 219 msec 2023-07-23 15:07:17,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-23 15:07:17,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1886eabdbf74e7807083d912991ebaf, UNASSIGN in 231 msec 2023-07-23 15:07:17,734 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124837734"}]},"ts":"1690124837734"} 2023-07-23 15:07:17,736 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-23 15:07:17,738 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-23 15:07:17,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 261 msec 2023-07-23 15:07:17,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 15:07:17,798 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-23 15:07:17,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-23 15:07:17,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:17,817 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:17,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-23 15:07:17,819 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:17,826 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:07:17,826 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb 2023-07-23 15:07:17,829 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-23 15:07:17,831 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/recovered.edits] 2023-07-23 15:07:17,831 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/recovered.edits] 2023-07-23 15:07:17,833 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 15:07:17,833 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 15:07:17,833 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 15:07:17,833 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 15:07:17,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 15:07:17,835 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:17,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 15:07:17,836 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:07:17,836 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:17,836 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:17,836 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 15:07:17,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 15:07:17,836 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:07:17,836 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:17,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-23 15:07:17,837 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:07:17,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 15:07:17,840 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/cf/2dd11cd0abbd4537a618295a6b325c53 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/cf/2dd11cd0abbd4537a618295a6b325c53 2023-07-23 15:07:17,841 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/cf/f582675255f34e89a3784e4a6dadd1e0 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/cf/f582675255f34e89a3784e4a6dadd1e0 2023-07-23 15:07:17,847 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb/recovered.edits/9.seqid 2023-07-23 15:07:17,847 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf/recovered.edits/9.seqid 2023-07-23 15:07:17,848 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/382b7c50824348996606d941d75dcfdb 2023-07-23 15:07:17,848 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportWithTargetName/f1886eabdbf74e7807083d912991ebaf 2023-07-23 15:07:17,848 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 15:07:17,848 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-23 15:07:17,849 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-23 15:07:17,853 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072379b8ac7eeae44583a3fd019993c8bf52 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072379b8ac7eeae44583a3fd019993c8bf52 2023-07-23 15:07:17,855 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723ae6580bed9b44a9ebf7f92527a9a0164 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723ae6580bed9b44a9ebf7f92527a9a0164 2023-07-23 15:07:17,855 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-23 15:07:17,859 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:17,881 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-23 15:07:17,885 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-23 15:07:17,888 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:17,888 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-23 15:07:17,888 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124837888"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:17,888 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124837888"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:17,890 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:07:17,891 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f1886eabdbf74e7807083d912991ebaf, NAME => 'testtb-testExportWithTargetName,,1690124819022.f1886eabdbf74e7807083d912991ebaf.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 382b7c50824348996606d941d75dcfdb, NAME => 'testtb-testExportWithTargetName,1,1690124819022.382b7c50824348996606d941d75dcfdb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:07:17,891 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-23 15:07:17,891 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124837891"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:17,893 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-23 15:07:17,895 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 15:07:17,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 88 msec 2023-07-23 15:07:17,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 15:07:17,942 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-23 15:07:17,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-23 15:07:17,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-23 15:07:17,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-23 15:07:17,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-23 15:07:18,000 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 706) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:40713 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:49540 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:50256 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1585995365_1 at /127.0.0.1:49512 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:47178 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:35741 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=199 (was 111) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=6558 (was 8328) 2023-07-23 15:07:18,000 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-23 15:07:18,019 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=199, ProcessCount=179, AvailableMemoryMB=6563 2023-07-23 15:07:18,020 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-23 15:07:18,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 15:07:18,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:18,026 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:07:18,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-23 15:07:18,028 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:07:18,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 15:07:18,030 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:18,030 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:18,031 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade empty. 2023-07-23 15:07:18,031 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397 empty. 2023-07-23 15:07:18,031 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:18,032 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:18,032 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 15:07:18,047 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 15:07:18,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2518ce9fc987dfa30e890d2368541ade, NAME => 'testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:07:18,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2c676a34cf0e9936f4de8ecbec221397, NAME => 'testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:07:18,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:18,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2518ce9fc987dfa30e890d2368541ade, disabling compactions & flushes 2023-07-23 15:07:18,095 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. after waiting 0 ms 2023-07-23 15:07:18,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,095 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,095 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2518ce9fc987dfa30e890d2368541ade: 2023-07-23 15:07:18,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2c676a34cf0e9936f4de8ecbec221397, disabling compactions & flushes 2023-07-23 15:07:18,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. after waiting 0 ms 2023-07-23 15:07:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:18,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:18,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2c676a34cf0e9936f4de8ecbec221397: 2023-07-23 15:07:18,107 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:07:18,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124838108"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124838108"}]},"ts":"1690124838108"} 2023-07-23 15:07:18,109 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124838108"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124838108"}]},"ts":"1690124838108"} 2023-07-23 15:07:18,112 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:07:18,113 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:07:18,113 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124838113"}]},"ts":"1690124838113"} 2023-07-23 15:07:18,115 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 15:07:18,119 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:07:18,120 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:07:18,120 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:07:18,120 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:07:18,120 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:07:18,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2518ce9fc987dfa30e890d2368541ade, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c676a34cf0e9936f4de8ecbec221397, ASSIGN}] 2023-07-23 15:07:18,124 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2518ce9fc987dfa30e890d2368541ade, ASSIGN 2023-07-23 15:07:18,124 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c676a34cf0e9936f4de8ecbec221397, ASSIGN 2023-07-23 15:07:18,125 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2518ce9fc987dfa30e890d2368541ade, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41023,1690124809736; forceNewPlan=false, retain=false 2023-07-23 15:07:18,125 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c676a34cf0e9936f4de8ecbec221397, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1690124809802; forceNewPlan=false, retain=false 2023-07-23 15:07:18,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 15:07:18,275 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:07:18,278 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2518ce9fc987dfa30e890d2368541ade, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2c676a34cf0e9936f4de8ecbec221397, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,278 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124838278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124838278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124838278"}]},"ts":"1690124838278"} 2023-07-23 15:07:18,278 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124838278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124838278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124838278"}]},"ts":"1690124838278"} 2023-07-23 15:07:18,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 2518ce9fc987dfa30e890d2368541ade, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:07:18,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 2c676a34cf0e9936f4de8ecbec221397, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:07:18,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 15:07:18,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:18,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2c676a34cf0e9936f4de8ecbec221397, NAME => 'testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:07:18,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2518ce9fc987dfa30e890d2368541ade, NAME => 'testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:07:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. service=AccessControlService 2023-07-23 15:07:18,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:07:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. service=AccessControlService 2023-07-23 15:07:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:18,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:07:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:18,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:18,439 INFO [StoreOpener-2c676a34cf0e9936f4de8ecbec221397-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:18,439 INFO [StoreOpener-2518ce9fc987dfa30e890d2368541ade-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:18,440 DEBUG [StoreOpener-2c676a34cf0e9936f4de8ecbec221397-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/cf 2023-07-23 15:07:18,440 DEBUG [StoreOpener-2518ce9fc987dfa30e890d2368541ade-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/cf 2023-07-23 15:07:18,440 DEBUG [StoreOpener-2c676a34cf0e9936f4de8ecbec221397-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/cf 2023-07-23 15:07:18,441 DEBUG [StoreOpener-2518ce9fc987dfa30e890d2368541ade-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/cf 2023-07-23 15:07:18,441 INFO [StoreOpener-2c676a34cf0e9936f4de8ecbec221397-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c676a34cf0e9936f4de8ecbec221397 columnFamilyName cf 2023-07-23 15:07:18,441 INFO [StoreOpener-2518ce9fc987dfa30e890d2368541ade-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2518ce9fc987dfa30e890d2368541ade columnFamilyName cf 2023-07-23 15:07:18,443 INFO [StoreOpener-2c676a34cf0e9936f4de8ecbec221397-1] regionserver.HStore(310): Store=2c676a34cf0e9936f4de8ecbec221397/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:07:18,444 INFO [StoreOpener-2518ce9fc987dfa30e890d2368541ade-1] regionserver.HStore(310): Store=2518ce9fc987dfa30e890d2368541ade/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:07:18,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:18,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:18,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:18,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:18,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:18,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:18,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:07:18,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2c676a34cf0e9936f4de8ecbec221397; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60293129, jitterRate=-0.10156236588954926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:07:18,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:07:18,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2c676a34cf0e9936f4de8ecbec221397: 2023-07-23 15:07:18,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2518ce9fc987dfa30e890d2368541ade; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63307224, jitterRate=-0.056648850440979004}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:07:18,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2518ce9fc987dfa30e890d2368541ade: 2023-07-23 15:07:18,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397., pid=31, masterSystemTime=1690124838433 2023-07-23 15:07:18,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade., pid=30, masterSystemTime=1690124838433 2023-07-23 15:07:18,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:18,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:18,459 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2c676a34cf0e9936f4de8ecbec221397, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,459 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124838459"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124838459"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124838459"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124838459"}]},"ts":"1690124838459"} 2023-07-23 15:07:18,462 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2518ce9fc987dfa30e890d2368541ade, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,462 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124838462"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124838462"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124838462"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124838462"}]},"ts":"1690124838462"} 2023-07-23 15:07:18,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-23 15:07:18,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 2c676a34cf0e9936f4de8ecbec221397, server=jenkins-hbase4.apache.org,42581,1690124809802 in 181 msec 2023-07-23 15:07:18,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c676a34cf0e9936f4de8ecbec221397, ASSIGN in 345 msec 2023-07-23 15:07:18,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-23 15:07:18,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 2518ce9fc987dfa30e890d2368541ade, server=jenkins-hbase4.apache.org,41023,1690124809736 in 184 msec 2023-07-23 15:07:18,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-23 15:07:18,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2518ce9fc987dfa30e890d2368541ade, ASSIGN in 347 msec 2023-07-23 15:07:18,470 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:07:18,471 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124838471"}]},"ts":"1690124838471"} 2023-07-23 15:07:18,472 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 15:07:18,474 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:07:18,475 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-23 15:07:18,477 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:07:18,478 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:18,478 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:18,478 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:18,478 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:18,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:18,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:18,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:18,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:18,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 457 msec 2023-07-23 15:07:18,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 15:07:18,632 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-23 15:07:18,635 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 15:07:18,635 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,638 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:18,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:18,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124838674 (current time:1690124838674). 2023-07-23 15:07:18,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:18,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x45a79034 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:18,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20872a59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:18,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:18,690 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:18,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45a79034 to 127.0.0.1:63816 2023-07-23 15:07:18,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:18,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x774e3082 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:18,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e11286f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:18,700 DEBUG [hconnection-0x17dd1e16-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:18,703 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:18,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:18,709 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:18,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x774e3082 to 127.0.0.1:63816 2023-07-23 15:07:18,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:18,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:07:18,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:18,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:18,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:18,718 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:18,720 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690125438720 2023-07-23 15:07:18,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:18,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 15:07:18,721 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:18,721 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:18,725 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:18,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:18,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-23 15:07:18,728 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:18,730 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690125438730 2023-07-23 15:07:18,758 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,759 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-23 15:07:18,759 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:18,760 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 15:07:18,760 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 15:07:18,761 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,761 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,764 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:18,764 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:18,764 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:18,764 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:18,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:18,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,765 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,765 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,766 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,766 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 15:07:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,766 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 15:07:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 15:07:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,767 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:18,767 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:18,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,769 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:18,769 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:18,772 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:18,772 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:18,772 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:18,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:18,774 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:18,776 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,781 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:18,781 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,782 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:18,782 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,782 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:18,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 15:07:18,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e883ca4[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:18,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 15:07:18,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e883ca4[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:18,787 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 15:07:18,787 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:18,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:18,789 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:07:18,789 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,789 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:18,789 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,790 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:18,789 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:18,790 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:18,790 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. started... 2023-07-23 15:07:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:18,790 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:18,790 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. started... 2023-07-23 15:07:18,790 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2518ce9fc987dfa30e890d2368541ade: 2023-07-23 15:07:18,791 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2c676a34cf0e9936f4de8ecbec221397: 2023-07-23 15:07:18,791 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,792 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:18,792 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,792 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:18,792 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:18,792 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:18,792 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:18,792 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:18,792 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:18,821 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:18,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:18,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:18,823 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:18,839 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. completed. 2023-07-23 15:07:18,839 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:18,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:18,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:18,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:18,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:07:18,842 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. completed. 2023-07-23 15:07:18,842 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:18,842 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:18,842 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:18,842 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,843 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:18,843 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:07:18,848 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,848 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:18,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:18,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:18,850 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,850 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:18,850 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:18,850 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:18,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:18,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:18,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42581,1690124809802': 2023-07-23 15:07:18,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 15:07:18,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:18,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:18,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:18,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:18,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:07:18,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 15:07:18,862 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-23 15:07:18,862 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:18,862 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:18,862 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,862 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:18,865 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:18,865 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:18,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:18,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,865 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:18,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:18,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:18,867 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,868 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:18,868 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:18,871 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,872 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,873 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,879 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,879 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,879 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:18,879 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,879 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,879 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,879 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:18,879 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:18,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:18,880 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:18,880 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:18,881 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:18,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:18,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:18,880 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:18,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:18,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:18,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:18,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:18,881 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:18,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,881 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:18,881 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:18,880 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:18,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-23 15:07:18,883 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,883 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:18,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:18,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:18,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:18,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:07:18,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 15:07:18,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,984 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 15:07:18,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,985 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:18,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690124838720Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690124838906 (+186 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690124838906Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690124838906Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690124838914 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690124838937 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690124838984 (+47 ms) 2023-07-23 15:07:18,988 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:18,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 266 msec 2023-07-23 15:07:19,023 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:19,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:19,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:19,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41023] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:19,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:19,039 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 15:07:19,039 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:19,040 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:19,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:19,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124839054 (current time:1690124839054). 2023-07-23 15:07:19,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:19,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x33432024 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:19,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c563e04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:19,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:19,067 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:19,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33432024 to 127.0.0.1:63816 2023-07-23 15:07:19,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:19,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x13f60f34 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:19,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34b5f047, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:19,083 DEBUG [hconnection-0x52d09b81-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:19,084 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:19,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:19,091 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:19,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13f60f34 to 127.0.0.1:63816 2023-07-23 15:07:19,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:19,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:07:19,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:19,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:19,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:19,097 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:19,098 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690125439098 2023-07-23 15:07:19,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 15:07:19,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:07:19,099 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:19,099 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:19,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:19,100 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:07:19,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-23 15:07:19,103 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:19,104 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690125439104 2023-07-23 15:07:19,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-23 15:07:19,120 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-23 15:07:19,120 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:19,122 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 15:07:19,122 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 15:07:19,123 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,123 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,124 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,124 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:19,124 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:19,124 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:19,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:19,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:19,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:19,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:19,124 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,125 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:19,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:19,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,126 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,126 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:19,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 15:07:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 15:07:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 15:07:19,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:19,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 15:07:19,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 15:07:19,132 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:19,132 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:19,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 15:07:19,137 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:19,137 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:19,136 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 15:07:19,135 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:19,138 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 15:07:19,138 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:19,138 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:19,138 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:19,138 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:19,138 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:19,138 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:19,140 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 15:07:19,140 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 15:07:19,140 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 15:07:19,141 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,141 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:19,142 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,142 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:19,143 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,143 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:19,143 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,143 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:19,144 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:19,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,145 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,145 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:19,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:19,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 15:07:19,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a6d4bf[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:19,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:19,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:19,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:19,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:19,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 15:07:19,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a6d4bf[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:19,151 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 15:07:19,151 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,152 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,152 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,152 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,153 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,153 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:19,153 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:19,153 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:07:19,153 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,153 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:19,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:19,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:07:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:19,154 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:19,154 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. started... 2023-07-23 15:07:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:19,154 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:19,155 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. started... 2023-07-23 15:07:19,154 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2518ce9fc987dfa30e890d2368541ade 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 15:07:19,155 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:19,155 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:19,155 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:19,157 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2c676a34cf0e9936f4de8ecbec221397 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 15:07:19,200 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:19,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:19,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:19,203 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307232c49f98f2af3499ba421640eb689e0a6 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307232c49f98f2af3499ba421640eb689e0a6 2023-07-23 15:07:19,204 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:19,220 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/.tmp/cf/1eac9778e3fd4f728b8b30f524eb55d5 2023-07-23 15:07:19,221 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230723880b9a46cca94097a9b06fd82df2abb9 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230723880b9a46cca94097a9b06fd82df2abb9 2023-07-23 15:07:19,229 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/.tmp/cf/1eac9778e3fd4f728b8b30f524eb55d5 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/cf/1eac9778e3fd4f728b8b30f524eb55d5 2023-07-23 15:07:19,235 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/cf/1eac9778e3fd4f728b8b30f524eb55d5, entries=4, sequenceid=6, filesize=5.6 K 2023-07-23 15:07:19,236 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 2518ce9fc987dfa30e890d2368541ade in 82ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:19,237 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-23 15:07:19,237 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2518ce9fc987dfa30e890d2368541ade: 2023-07-23 15:07:19,238 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 15:07:19,238 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:19,238 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/cf/1eac9778e3fd4f728b8b30f524eb55d5] hfiles 2023-07-23 15:07:19,238 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/cf/1eac9778e3fd4f728b8b30f524eb55d5 for snapshot=snaptb0-testExportFileSystemState 2023-07-23 15:07:19,238 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/.tmp/cf/402286c617d8473aae7ebe7d8673f80a 2023-07-23 15:07:19,245 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/.tmp/cf/402286c617d8473aae7ebe7d8673f80a as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/cf/402286c617d8473aae7ebe7d8673f80a 2023-07-23 15:07:19,251 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/cf/402286c617d8473aae7ebe7d8673f80a, entries=46, sequenceid=6, filesize=12.7 K 2023-07-23 15:07:19,252 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2c676a34cf0e9936f4de8ecbec221397 in 97ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:19,254 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2c676a34cf0e9936f4de8ecbec221397: 2023-07-23 15:07:19,254 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 15:07:19,255 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:19,255 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/cf/402286c617d8473aae7ebe7d8673f80a] hfiles 2023-07-23 15:07:19,255 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/cf/402286c617d8473aae7ebe7d8673f80a for snapshot=snaptb0-testExportFileSystemState 2023-07-23 15:07:19,257 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. completed. 2023-07-23 15:07:19,257 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:19,257 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:19,257 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:19,257 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,257 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:19,257 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:07:19,263 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:19,263 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,264 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:19,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,264 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:19,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:19,265 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. completed. 2023-07-23 15:07:19,265 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:19,265 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:19,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:19,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:19,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 15:07:19,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:07:19,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:19,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,267 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,267 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 15:07:19,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:19,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 15:07:19,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:07:19,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 15:07:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42581,1690124809802': 2023-07-23 15:07:19,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 15:07:19,276 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-23 15:07:19,276 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:19,276 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:19,276 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-23 15:07:19,276 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:19,278 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,278 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:19,278 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,278 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,279 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:19,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,280 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:19,280 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:19,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 15:07:19,282 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,283 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,283 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,286 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:19,286 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:19,286 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,286 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,286 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:19,286 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:19,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:19,287 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:19,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:19,286 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:19,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:19,286 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:19,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-23 15:07:19,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:19,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-23 15:07:19,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,288 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 15:07:19,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:07:19,288 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,288 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,288 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:19,288 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,288 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:19,288 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:19,288 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,288 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:19,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:19,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230723880b9a46cca94097a9b06fd82df2abb9, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307232c49f98f2af3499ba421640eb689e0a6] mob files 2023-07-23 15:07:19,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230723880b9a46cca94097a9b06fd82df2abb9 2023-07-23 15:07:19,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307232c49f98f2af3499ba421640eb689e0a6 2023-07-23 15:07:19,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-23 15:07:19,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,351 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 15:07:19,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,352 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690124839098Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690124839297 (+199 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690124839297Loading Region manifests for snaptb0-testExportFileSystemState at 1690124839297Writing data manifest for snaptb0-testExportFileSystemState at 1690124839302 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690124839311 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690124839351 (+40 ms) 2023-07-23 15:07:19,355 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 15:07:19,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 256 msec 2023-07-23 15:07:19,404 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:19,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:07:19,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:19,405 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405 2023-07-23 15:07:19,406 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44181, tgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405, rawTgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405, srcFsUri=hdfs://localhost:44181, srcDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:07:19,429 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:07:19,429 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_903068731_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,429 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661, snapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-23 15:07:19,441 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 15:07:19,465 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,466 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,466 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,466 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,467 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,467 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,467 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,537 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop-8690187023516969191.jar 2023-07-23 15:07:19,538 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,538 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,538 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,539 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,539 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,539 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:19,540 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:07:19,540 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:07:19,540 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:07:19,541 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:07:19,541 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:07:19,542 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:07:19,542 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:07:19,542 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:07:19,543 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:07:19,543 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:07:19,544 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:19,544 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:19,544 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:19,545 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:19,545 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:19,545 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:19,546 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:20,540 WARN [Listener at jenkins-hbase4.apache.org/42857] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:07:20,543 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-23 15:07:20,546 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-23 15:07:21,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:21,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:21,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0001_000001 (auth:SIMPLE) 2023-07-23 15:07:21,929 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:23,313 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:07:26,651 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:28,917 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:32,478 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:33,747 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:07:33,748 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:07:33,757 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-23 15:07:33,757 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:07:33,758 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:07:33,758 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 15:07:33,758 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 15:07:33,759 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 15:07:33,759 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 15:07:33,759 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 15:07:33,759 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124839405/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 15:07:33,768 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-23 15:07:33,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-23 15:07:33,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:33,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 15:07:33,777 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124853777"}]},"ts":"1690124853777"} 2023-07-23 15:07:33,779 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 15:07:33,781 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-23 15:07:33,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2518ce9fc987dfa30e890d2368541ade, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c676a34cf0e9936f4de8ecbec221397, UNASSIGN}] 2023-07-23 15:07:33,784 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2518ce9fc987dfa30e890d2368541ade, UNASSIGN 2023-07-23 15:07:33,784 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c676a34cf0e9936f4de8ecbec221397, UNASSIGN 2023-07-23 15:07:33,785 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2518ce9fc987dfa30e890d2368541ade, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:33,785 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2c676a34cf0e9936f4de8ecbec221397, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:33,785 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124853785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124853785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124853785"}]},"ts":"1690124853785"} 2023-07-23 15:07:33,786 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124853785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124853785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124853785"}]},"ts":"1690124853785"} 2023-07-23 15:07:33,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 2c676a34cf0e9936f4de8ecbec221397, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:07:33,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 2518ce9fc987dfa30e890d2368541ade, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:07:33,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 15:07:33,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:33,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2c676a34cf0e9936f4de8ecbec221397, disabling compactions & flushes 2023-07-23 15:07:33,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:33,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:33,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. after waiting 0 ms 2023-07-23 15:07:33,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:33,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:33,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2518ce9fc987dfa30e890d2368541ade, disabling compactions & flushes 2023-07-23 15:07:33,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:33,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:33,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. after waiting 0 ms 2023-07-23 15:07:33,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:33,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:07:33,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:07:33,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:07:33,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:07:33,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade. 2023-07-23 15:07:33,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2518ce9fc987dfa30e890d2368541ade: 2023-07-23 15:07:33,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397. 2023-07-23 15:07:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2c676a34cf0e9936f4de8ecbec221397: 2023-07-23 15:07:33,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:33,967 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2c676a34cf0e9936f4de8ecbec221397, regionState=CLOSED 2023-07-23 15:07:33,967 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124853967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124853967"}]},"ts":"1690124853967"} 2023-07-23 15:07:33,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:33,968 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2518ce9fc987dfa30e890d2368541ade, regionState=CLOSED 2023-07-23 15:07:33,968 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690124853968"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124853968"}]},"ts":"1690124853968"} 2023-07-23 15:07:33,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-23 15:07:33,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 2c676a34cf0e9936f4de8ecbec221397, server=jenkins-hbase4.apache.org,42581,1690124809802 in 182 msec 2023-07-23 15:07:33,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-23 15:07:33,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 2518ce9fc987dfa30e890d2368541ade, server=jenkins-hbase4.apache.org,41023,1690124809736 in 182 msec 2023-07-23 15:07:33,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2c676a34cf0e9936f4de8ecbec221397, UNASSIGN in 191 msec 2023-07-23 15:07:33,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-23 15:07:33,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2518ce9fc987dfa30e890d2368541ade, UNASSIGN in 192 msec 2023-07-23 15:07:33,977 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124853977"}]},"ts":"1690124853977"} 2023-07-23 15:07:33,978 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 15:07:33,980 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-23 15:07:33,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 213 msec 2023-07-23 15:07:34,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 15:07:34,080 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-23 15:07:34,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-23 15:07:34,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:34,085 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:34,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-23 15:07:34,086 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:34,088 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-23 15:07:34,092 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:34,092 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:34,093 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:34,093 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:34,093 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:34,093 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:34,094 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 15:07:34,094 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 15:07:34,094 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 15:07:34,094 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 15:07:34,095 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/recovered.edits] 2023-07-23 15:07:34,095 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:34,095 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,095 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:34,095 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:34,095 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,096 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 15:07:34,096 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,095 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 15:07:34,097 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/recovered.edits] 2023-07-23 15:07:34,102 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/cf/402286c617d8473aae7ebe7d8673f80a to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/cf/402286c617d8473aae7ebe7d8673f80a 2023-07-23 15:07:34,103 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/cf/1eac9778e3fd4f728b8b30f524eb55d5 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/cf/1eac9778e3fd4f728b8b30f524eb55d5 2023-07-23 15:07:34,106 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397/recovered.edits/9.seqid 2023-07-23 15:07:34,106 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade/recovered.edits/9.seqid 2023-07-23 15:07:34,107 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2c676a34cf0e9936f4de8ecbec221397 2023-07-23 15:07:34,107 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemState/2518ce9fc987dfa30e890d2368541ade 2023-07-23 15:07:34,107 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 15:07:34,108 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-23 15:07:34,109 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-23 15:07:34,113 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230723880b9a46cca94097a9b06fd82df2abb9 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230723880b9a46cca94097a9b06fd82df2abb9 2023-07-23 15:07:34,115 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307232c49f98f2af3499ba421640eb689e0a6 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307232c49f98f2af3499ba421640eb689e0a6 2023-07-23 15:07:34,115 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-23 15:07:34,118 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:34,121 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-23 15:07:34,129 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-23 15:07:34,130 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:34,130 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-23 15:07:34,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124854130"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:34,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124854130"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:34,137 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:07:34,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2518ce9fc987dfa30e890d2368541ade, NAME => 'testtb-testExportFileSystemState,,1690124838021.2518ce9fc987dfa30e890d2368541ade.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2c676a34cf0e9936f4de8ecbec221397, NAME => 'testtb-testExportFileSystemState,1,1690124838021.2c676a34cf0e9936f4de8ecbec221397.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:07:34,137 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-23 15:07:34,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124854137"}]},"ts":"9223372036854775807"} 2023-07-23 15:07:34,140 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-23 15:07:34,142 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 15:07:34,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 62 msec 2023-07-23 15:07:34,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 15:07:34,198 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-23 15:07:34,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-23 15:07:34,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-23 15:07:34,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-23 15:07:34,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-23 15:07:34,245 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 752) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:49240 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:39631 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:57196 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1609560592_1 at /127.0.0.1:50360 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2025 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:50384 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1609560592_1 at /127.0.0.1:49228 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 925) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=275 (was 199) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=6273 (was 6563) 2023-07-23 15:07:34,245 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-23 15:07:34,266 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=275, ProcessCount=179, AvailableMemoryMB=6272 2023-07-23 15:07:34,266 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-23 15:07:34,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 15:07:34,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:07:34,272 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:07:34,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-23 15:07:34,273 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:07:34,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 15:07:34,276 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:07:34,276 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982 2023-07-23 15:07:34,277 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c empty. 2023-07-23 15:07:34,277 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982 empty. 2023-07-23 15:07:34,277 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:07:34,277 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982 2023-07-23 15:07:34,277 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 15:07:34,293 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-23 15:07:34,295 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 885028b95a863aa4771088f4b9b56b6c, NAME => 'testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:07:34,295 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 73cc90ebe486fbd51234e33b01263982, NAME => 'testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 885028b95a863aa4771088f4b9b56b6c, disabling compactions & flushes 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 73cc90ebe486fbd51234e33b01263982, disabling compactions & flushes 2023-07-23 15:07:34,317 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,317 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. after waiting 0 ms 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. after waiting 0 ms 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:34,317 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,317 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 885028b95a863aa4771088f4b9b56b6c: 2023-07-23 15:07:34,317 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 73cc90ebe486fbd51234e33b01263982: 2023-07-23 15:07:34,320 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:07:34,321 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124854321"}]},"ts":"1690124854321"} 2023-07-23 15:07:34,321 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124854321"}]},"ts":"1690124854321"} 2023-07-23 15:07:34,323 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:07:34,325 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:07:34,325 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124854325"}]},"ts":"1690124854325"} 2023-07-23 15:07:34,326 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-23 15:07:34,331 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:07:34,332 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:07:34,332 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:07:34,332 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:07:34,332 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:07:34,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=885028b95a863aa4771088f4b9b56b6c, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73cc90ebe486fbd51234e33b01263982, ASSIGN}] 2023-07-23 15:07:34,335 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73cc90ebe486fbd51234e33b01263982, ASSIGN 2023-07-23 15:07:34,335 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=885028b95a863aa4771088f4b9b56b6c, ASSIGN 2023-07-23 15:07:34,336 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=885028b95a863aa4771088f4b9b56b6c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38883,1690124809666; forceNewPlan=false, retain=false 2023-07-23 15:07:34,336 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73cc90ebe486fbd51234e33b01263982, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41023,1690124809736; forceNewPlan=false, retain=false 2023-07-23 15:07:34,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 15:07:34,487 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:07:34,489 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=73cc90ebe486fbd51234e33b01263982, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,489 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=885028b95a863aa4771088f4b9b56b6c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,489 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854489"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124854489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124854489"}]},"ts":"1690124854489"} 2023-07-23 15:07:34,490 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854489"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124854489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124854489"}]},"ts":"1690124854489"} 2023-07-23 15:07:34,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 73cc90ebe486fbd51234e33b01263982, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:07:34,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 885028b95a863aa4771088f4b9b56b6c, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:07:34,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 15:07:34,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:34,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 73cc90ebe486fbd51234e33b01263982, NAME => 'testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:07:34,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. service=AccessControlService 2023-07-23 15:07:34,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:07:34,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 73cc90ebe486fbd51234e33b01263982 2023-07-23 15:07:34,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:34,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 73cc90ebe486fbd51234e33b01263982 2023-07-23 15:07:34,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 73cc90ebe486fbd51234e33b01263982 2023-07-23 15:07:34,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 885028b95a863aa4771088f4b9b56b6c, NAME => 'testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:07:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. service=AccessControlService 2023-07-23 15:07:34,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:07:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:07:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:07:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:07:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:07:34,652 INFO [StoreOpener-73cc90ebe486fbd51234e33b01263982-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 73cc90ebe486fbd51234e33b01263982 2023-07-23 15:07:34,653 INFO [StoreOpener-885028b95a863aa4771088f4b9b56b6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:07:34,654 DEBUG [StoreOpener-73cc90ebe486fbd51234e33b01263982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/cf 2023-07-23 15:07:34,654 DEBUG [StoreOpener-73cc90ebe486fbd51234e33b01263982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/cf 2023-07-23 15:07:34,654 INFO [StoreOpener-73cc90ebe486fbd51234e33b01263982-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73cc90ebe486fbd51234e33b01263982 columnFamilyName cf 2023-07-23 15:07:34,655 DEBUG [StoreOpener-885028b95a863aa4771088f4b9b56b6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/cf 2023-07-23 15:07:34,655 DEBUG [StoreOpener-885028b95a863aa4771088f4b9b56b6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/cf 2023-07-23 15:07:34,655 INFO [StoreOpener-885028b95a863aa4771088f4b9b56b6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 885028b95a863aa4771088f4b9b56b6c columnFamilyName cf 2023-07-23 15:07:34,656 INFO [StoreOpener-73cc90ebe486fbd51234e33b01263982-1] regionserver.HStore(310): Store=73cc90ebe486fbd51234e33b01263982/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:07:34,656 INFO [StoreOpener-885028b95a863aa4771088f4b9b56b6c-1] regionserver.HStore(310): Store=885028b95a863aa4771088f4b9b56b6c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:07:34,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982 2023-07-23 15:07:34,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:07:34,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982 2023-07-23 15:07:34,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:07:34,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 73cc90ebe486fbd51234e33b01263982 2023-07-23 15:07:34,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:07:34,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:07:34,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 73cc90ebe486fbd51234e33b01263982; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69525646, jitterRate=0.036012858152389526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:07:34,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 73cc90ebe486fbd51234e33b01263982: 2023-07-23 15:07:34,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982., pid=45, masterSystemTime=1690124854643 2023-07-23 15:07:34,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:07:34,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 885028b95a863aa4771088f4b9b56b6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69731507, jitterRate=0.0390804260969162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:07:34,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 885028b95a863aa4771088f4b9b56b6c: 2023-07-23 15:07:34,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c., pid=46, masterSystemTime=1690124854644 2023-07-23 15:07:34,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:34,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:34,669 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=73cc90ebe486fbd51234e33b01263982, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,669 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854669"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124854669"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124854669"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124854669"}]},"ts":"1690124854669"} 2023-07-23 15:07:34,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,670 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=885028b95a863aa4771088f4b9b56b6c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,670 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124854670"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124854670"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124854670"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124854670"}]},"ts":"1690124854670"} 2023-07-23 15:07:34,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-23 15:07:34,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 73cc90ebe486fbd51234e33b01263982, server=jenkins-hbase4.apache.org,41023,1690124809736 in 182 msec 2023-07-23 15:07:34,677 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-23 15:07:34,677 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 885028b95a863aa4771088f4b9b56b6c, server=jenkins-hbase4.apache.org,38883,1690124809666 in 182 msec 2023-07-23 15:07:34,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73cc90ebe486fbd51234e33b01263982, ASSIGN in 344 msec 2023-07-23 15:07:34,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-23 15:07:34,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=885028b95a863aa4771088f4b9b56b6c, ASSIGN in 345 msec 2023-07-23 15:07:34,680 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:07:34,680 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124854680"}]},"ts":"1690124854680"} 2023-07-23 15:07:34,682 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-23 15:07:34,685 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:07:34,685 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-23 15:07:34,688 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 15:07:34,689 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,689 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,689 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,689 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:07:34,691 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:07:34,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:34,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:34,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:34,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 15:07:34,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 424 msec 2023-07-23 15:07:34,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 15:07:34,878 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-23 15:07:34,881 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 15:07:34,881 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,884 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:34,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:34,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124854896 (current time:1690124854896). 2023-07-23 15:07:34,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:34,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x10b47090 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:34,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3da1f6ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:34,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:34,907 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:34,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10b47090 to 127.0.0.1:63816 2023-07-23 15:07:34,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:34,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x692624fb to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:34,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a25f9bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:34,914 DEBUG [hconnection-0x68816a88-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:34,916 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:34,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:34,922 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:34,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x692624fb to 127.0.0.1:63816 2023-07-23 15:07:34,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:34,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 15:07:34,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:34,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:34,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:34,927 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:34,928 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690125454928 2023-07-23 15:07:34,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:34,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 15:07:34,929 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:34,929 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:34,932 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:34,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:34,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-23 15:07:34,935 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:34,935 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690125454935 2023-07-23 15:07:34,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,945 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-23 15:07:34,945 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:34,946 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 15:07:34,946 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 15:07:34,946 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,946 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,949 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:34,949 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:34,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:34,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:34,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:34,949 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,949 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:34,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:34,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:34,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:34,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,949 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,949 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,952 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,952 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:34,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:34,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,955 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:34,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:34,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:34,955 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:34,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:34,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:34,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:34,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,956 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:34,957 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:34,957 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:34,957 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:34,957 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:34,960 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:34,960 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:34,960 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:34,961 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,962 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,962 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:34,963 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,963 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:34,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:34,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:34,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 15:07:34,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ba64225[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:34,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:34,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:34,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:34,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:34,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:34,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:34,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 15:07:34,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ba64225[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:34,967 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 15:07:34,967 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,969 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,969 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,969 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,970 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:34,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,970 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,970 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:34,970 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:34,970 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:34,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,970 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:34,970 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:34,970 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:34,970 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,970 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. started... 2023-07-23 15:07:34,970 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. started... 2023-07-23 15:07:34,970 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,970 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,971 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73cc90ebe486fbd51234e33b01263982: 2023-07-23 15:07:34,971 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:34,971 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 885028b95a863aa4771088f4b9b56b6c: 2023-07-23 15:07:34,971 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:34,971 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:07:34,971 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,971 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,972 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:34,972 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:34,972 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:34,972 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:07:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:34,990 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. completed. 2023-07-23 15:07:34,990 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:34,990 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:34,990 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:34,990 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,990 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:34,990 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:07:34,990 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. completed. 2023-07-23 15:07:34,990 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:34,991 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:34,991 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:34,991 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,991 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:34,991 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:07:34,992 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:34,992 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,992 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:34,992 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:34,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:34,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:34,993 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:34,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:34,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:34,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:34,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:34,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38883,1690124809666': 2023-07-23 15:07:34,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 15:07:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:34,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:07:35,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 15:07:35,001 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-23 15:07:35,001 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:35,001 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:35,001 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,001 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:35,003 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,003 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,003 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,003 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,003 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,003 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,004 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,003 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,004 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,005 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,007 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,007 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,008 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-23 15:07:35,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,012 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:35,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,012 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,013 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:07:35,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,013 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,013 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,014 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,014 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,014 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,014 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 15:07:35,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,029 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:35,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 15:07:35,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:35,031 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:35,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,231 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:35,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 15:07:35,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:35,232 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:07:35,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 15:07:35,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,482 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 15:07:35,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690124854928Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690124855022 (+94 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690124855022Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690124855022Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690124855026 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690124855039 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690124855482 (+443 ms) 2023-07-23 15:07:35,485 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:35,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 556 msec 2023-07-23 15:07:35,533 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:35,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 15:07:35,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:35,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38883] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:35,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41023] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:07:35,541 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 15:07:35,541 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:35,541 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:07:35,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:35,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124855553 (current time:1690124855553). 2023-07-23 15:07:35,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:07:35,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x011a1d0b to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:35,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16823b67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:35,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:35,571 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:35,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x011a1d0b to 127.0.0.1:63816 2023-07-23 15:07:35,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:35,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x42ffb80d to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:07:35,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@135c071c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:07:35,579 DEBUG [hconnection-0x14825f13-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:35,582 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:35,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:07:35,586 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:07:35,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42ffb80d to 127.0.0.1:63816 2023-07-23 15:07:35,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:07:35,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 15:07:35,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:07:35,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:35,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:35,592 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:35,593 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690125455593 2023-07-23 15:07:35,593 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 15:07:35,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 15:07:35,595 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:07:35,595 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:07:35,597 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 15:07:35,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:35,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-23 15:07:35,599 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:35,600 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690125455600 2023-07-23 15:07:35,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-23 15:07:35,620 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-23 15:07:35,620 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:35,622 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 15:07:35,622 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 15:07:35,622 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,622 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,624 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,624 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,624 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,624 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,625 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,625 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,630 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,630 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:07:35,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 15:07:35,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 15:07:35,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:35,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:35,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 15:07:35,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,631 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 15:07:35,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 15:07:35,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 15:07:35,632 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:35,632 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:35,632 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:35,632 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:35,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 15:07:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 15:07:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:07:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 15:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 15:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:35,643 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 15:07:35,646 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,646 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,646 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,646 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,648 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,648 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,648 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:35,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:07:35,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 15:07:35,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d8a0dc5[Count = 1] remaining members to acquire global barrier 2023-07-23 15:07:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 15:07:35,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d8a0dc5[Count = 0] remaining members to acquire global barrier 2023-07-23 15:07:35,654 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 15:07:35,655 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,656 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,656 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,657 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:35,657 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,657 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:35,657 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,657 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:07:35,658 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:35,658 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:35,659 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:35,659 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. started... 2023-07-23 15:07:35,659 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 73cc90ebe486fbd51234e33b01263982 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-23 15:07:35,661 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:07:35,661 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:07:35,661 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:35,661 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. started... 2023-07-23 15:07:35,661 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 885028b95a863aa4771088f4b9b56b6c 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-23 15:07:35,662 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,663 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 15:07:35,663 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:35,663 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:07:35,666 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:35,666 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:35,666 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:35,695 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:35,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 15:07:35,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:07:35,697 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:07:35,714 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072347bee9aebdd446ea9e78089dd4c60a9e to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072347bee9aebdd446ea9e78089dd4c60a9e 2023-07-23 15:07:35,716 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072392a42c80ecad4a799ee8aa81439ae102 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072392a42c80ecad4a799ee8aa81439ae102 2023-07-23 15:07:35,737 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/.tmp/cf/ceb222b287a2412da9281c24b77ef5b5 2023-07-23 15:07:35,743 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/.tmp/cf/9028b6064540461499829eb7ede232d4 2023-07-23 15:07:35,746 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/.tmp/cf/ceb222b287a2412da9281c24b77ef5b5 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/cf/ceb222b287a2412da9281c24b77ef5b5 2023-07-23 15:07:35,750 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/.tmp/cf/9028b6064540461499829eb7ede232d4 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/cf/9028b6064540461499829eb7ede232d4 2023-07-23 15:07:35,754 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/cf/ceb222b287a2412da9281c24b77ef5b5, entries=45, sequenceid=6, filesize=12.4 K 2023-07-23 15:07:35,755 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 73cc90ebe486fbd51234e33b01263982 in 96ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:35,755 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-23 15:07:35,756 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73cc90ebe486fbd51234e33b01263982: 2023-07-23 15:07:35,756 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 15:07:35,756 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:35,756 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/cf/ceb222b287a2412da9281c24b77ef5b5] hfiles 2023-07-23 15:07:35,756 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/cf/ceb222b287a2412da9281c24b77ef5b5 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 15:07:35,756 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/cf/9028b6064540461499829eb7ede232d4, entries=5, sequenceid=6, filesize=5.7 K 2023-07-23 15:07:35,757 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 885028b95a863aa4771088f4b9b56b6c in 96ms, sequenceid=6, compaction requested=false 2023-07-23 15:07:35,759 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 885028b95a863aa4771088f4b9b56b6c: 2023-07-23 15:07:35,760 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 15:07:35,760 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:07:35,760 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/cf/9028b6064540461499829eb7ede232d4] hfiles 2023-07-23 15:07:35,760 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/cf/9028b6064540461499829eb7ede232d4 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 15:07:35,789 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. completed. 2023-07-23 15:07:35,789 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:07:35,791 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:35,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:35,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,795 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. completed. 2023-07-23 15:07:35,795 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:07:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:07:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:07:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 15:07:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:07:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,797 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 15:07:35,797 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:35,797 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,797 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 15:07:35,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:07:35,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 15:07:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38883,1690124809666': 2023-07-23 15:07:35,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 15:07:35,807 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-23 15:07:35,807 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:07:35,807 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:07:35,807 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-23 15:07:35,807 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:07:35,809 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,809 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,809 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,809 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,809 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,809 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,809 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:07:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:07:35,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,810 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:07:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,811 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,811 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:07:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:07:35,815 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 15:07:35,816 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,816 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,824 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,824 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,824 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:07:35,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:07:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:07:35,825 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-23 15:07:35,825 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-23 15:07:35,824 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,824 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:07:35,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 15:07:35,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,825 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,825 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,824 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:07:35,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:07:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,827 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,827 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,827 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,827 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:07:35,827 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,827 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:07:35,827 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:07:35,827 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,827 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:07:35,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:07:35,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072347bee9aebdd446ea9e78089dd4c60a9e, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072392a42c80ecad4a799ee8aa81439ae102] mob files 2023-07-23 15:07:35,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072347bee9aebdd446ea9e78089dd4c60a9e 2023-07-23 15:07:35,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072392a42c80ecad4a799ee8aa81439ae102 2023-07-23 15:07:35,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-23 15:07:35,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 15:07:35,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,895 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690124855593Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690124855837 (+244 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690124855837Loading Region manifests for snaptb0-testConsecutiveExports at 1690124855837Writing data manifest for snaptb0-testConsecutiveExports at 1690124855843 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690124855852 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690124855894 (+42 ms) 2023-07-23 15:07:35,897 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:07:35,898 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 15:07:35,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 15:07:35,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:07:35,900 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900 2023-07-23 15:07:35,900 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900, srcFsUri=hdfs://localhost:44181, srcDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:07:35,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 303 msec 2023-07-23 15:07:35,925 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:07:35,925 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@50d0b01f, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,925 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661, snapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 15:07:35,933 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:35,945 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,946 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,946 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,946 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,947 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,947 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:35,947 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:36,015 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop-8297813848977624463.jar 2023-07-23 15:07:36,016 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:36,016 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:36,016 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:36,017 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:36,017 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:36,017 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:36,018 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:07:36,018 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:07:36,018 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:07:36,019 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:07:36,019 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:07:36,020 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:07:36,020 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:07:36,020 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:07:36,021 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:07:36,021 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:07:36,021 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:36,022 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:36,022 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:36,023 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:36,023 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:36,023 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:36,024 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:36,499 WARN [Listener at jenkins-hbase4.apache.org/42857] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:07:36,502 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 15:07:36,505 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-23 15:07:38,652 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:38,652 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:38,655 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0002_000001 (auth:SIMPLE) 2023-07-23 15:07:39,556 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:07:39,611 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:44,037 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:46,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:49,050 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:50,915 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:07:50,916 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:07:50,920 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 15:07:50,920 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:07:50,921 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:07:50,921 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:07:50,923 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 15:07:50,923 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 15:07:50,923 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2c8f9a81 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:07:50,924 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 15:07:50,924 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 15:07:50,925 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900, srcFsUri=hdfs://localhost:44181, srcDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:07:50,946 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:07:50,946 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@27920328, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:50,946 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661, snapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 15:07:50,961 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 15:07:50,979 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:50,979 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:50,979 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:50,980 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:50,980 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:50,980 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:50,981 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:51,049 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop-6873484523730340270.jar 2023-07-23 15:07:51,049 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:51,050 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:51,050 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:51,050 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:51,051 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:51,051 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:07:51,051 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:07:51,052 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:07:51,052 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:07:51,052 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:07:51,053 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:07:51,053 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:07:51,054 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:07:51,054 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:07:51,054 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:07:51,055 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:07:51,055 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:51,055 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:51,056 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:51,056 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:51,056 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:07:51,056 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:51,057 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:07:51,455 WARN [Listener at jenkins-hbase4.apache.org/42857] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:07:51,458 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 15:07:51,460 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-23 15:07:55,236 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:55,236 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:07:55,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0003_000001 (auth:SIMPLE) 2023-07-23 15:07:55,668 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0004_000001 (auth:SIMPLE) 2023-07-23 15:08:00,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0004_000001 (auth:SIMPLE) 2023-07-23 15:08:02,490 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0004_000001 (auth:SIMPLE) 2023-07-23 15:08:05,176 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0004_000001 (auth:SIMPLE) 2023-07-23 15:08:06,650 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:08:06,650 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:08:06,653 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 15:08:06,654 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:08:06,654 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:08:06,654 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:08:06,657 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 15:08:06,657 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 15:08:06,657 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2c8f9a81 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 15:08:06,657 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 15:08:06,657 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/local-export-1690124855900/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 15:08:06,670 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-23 15:08:06,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-23 15:08:06,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 15:08:06,675 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124886675"}]},"ts":"1690124886675"} 2023-07-23 15:08:06,676 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-23 15:08:06,678 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-23 15:08:06,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=885028b95a863aa4771088f4b9b56b6c, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73cc90ebe486fbd51234e33b01263982, UNASSIGN}] 2023-07-23 15:08:06,681 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=885028b95a863aa4771088f4b9b56b6c, UNASSIGN 2023-07-23 15:08:06,681 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73cc90ebe486fbd51234e33b01263982, UNASSIGN 2023-07-23 15:08:06,682 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=885028b95a863aa4771088f4b9b56b6c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:06,682 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=73cc90ebe486fbd51234e33b01263982, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:06,682 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124886682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124886682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124886682"}]},"ts":"1690124886682"} 2023-07-23 15:08:06,682 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124886682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124886682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124886682"}]},"ts":"1690124886682"} 2023-07-23 15:08:06,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 885028b95a863aa4771088f4b9b56b6c, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:08:06,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 73cc90ebe486fbd51234e33b01263982, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:08:06,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 15:08:06,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:08:06,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 885028b95a863aa4771088f4b9b56b6c, disabling compactions & flushes 2023-07-23 15:08:06,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:08:06,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:08:06,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. after waiting 0 ms 2023-07-23 15:08:06,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:08:06,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 73cc90ebe486fbd51234e33b01263982 2023-07-23 15:08:06,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 73cc90ebe486fbd51234e33b01263982, disabling compactions & flushes 2023-07-23 15:08:06,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:08:06,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:08:06,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. after waiting 0 ms 2023-07-23 15:08:06,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:08:06,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:06,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:06,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:06,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:06,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c. 2023-07-23 15:08:06,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982. 2023-07-23 15:08:06,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 73cc90ebe486fbd51234e33b01263982: 2023-07-23 15:08:06,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 885028b95a863aa4771088f4b9b56b6c: 2023-07-23 15:08:06,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:08:06,854 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=885028b95a863aa4771088f4b9b56b6c, regionState=CLOSED 2023-07-23 15:08:06,855 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124886854"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124886854"}]},"ts":"1690124886854"} 2023-07-23 15:08:06,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 73cc90ebe486fbd51234e33b01263982 2023-07-23 15:08:06,855 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=73cc90ebe486fbd51234e33b01263982, regionState=CLOSED 2023-07-23 15:08:06,855 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690124886855"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124886855"}]},"ts":"1690124886855"} 2023-07-23 15:08:06,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-23 15:08:06,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 885028b95a863aa4771088f4b9b56b6c, server=jenkins-hbase4.apache.org,38883,1690124809666 in 172 msec 2023-07-23 15:08:06,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-23 15:08:06,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 73cc90ebe486fbd51234e33b01263982, server=jenkins-hbase4.apache.org,41023,1690124809736 in 172 msec 2023-07-23 15:08:06,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=885028b95a863aa4771088f4b9b56b6c, UNASSIGN in 179 msec 2023-07-23 15:08:06,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-23 15:08:06,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=73cc90ebe486fbd51234e33b01263982, UNASSIGN in 179 msec 2023-07-23 15:08:06,861 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124886861"}]},"ts":"1690124886861"} 2023-07-23 15:08:06,862 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-23 15:08:06,863 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-23 15:08:06,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 194 msec 2023-07-23 15:08:06,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 15:08:06,977 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-23 15:08:06,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-23 15:08:06,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,981 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-23 15:08:06,982 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:06,986 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-23 15:08:06,989 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,989 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,989 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,990 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 15:08:06,991 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 15:08:06,991 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:06,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-23 15:08:06,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-23 15:08:06,991 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:06,991 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:06,991 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:06,991 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:08:06,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-23 15:08:06,992 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:08:06,991 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:08:06,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 15:08:06,994 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:08:06,994 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982 2023-07-23 15:08:06,996 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/recovered.edits] 2023-07-23 15:08:06,996 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/recovered.edits] 2023-07-23 15:08:07,001 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/cf/ceb222b287a2412da9281c24b77ef5b5 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/cf/ceb222b287a2412da9281c24b77ef5b5 2023-07-23 15:08:07,001 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/cf/9028b6064540461499829eb7ede232d4 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/cf/9028b6064540461499829eb7ede232d4 2023-07-23 15:08:07,009 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982/recovered.edits/9.seqid 2023-07-23 15:08:07,010 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/73cc90ebe486fbd51234e33b01263982 2023-07-23 15:08:07,010 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c/recovered.edits/9.seqid 2023-07-23 15:08:07,011 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testConsecutiveExports/885028b95a863aa4771088f4b9b56b6c 2023-07-23 15:08:07,011 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 15:08:07,012 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-23 15:08:07,012 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-23 15:08:07,016 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072347bee9aebdd446ea9e78089dd4c60a9e to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072347bee9aebdd446ea9e78089dd4c60a9e 2023-07-23 15:08:07,017 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072392a42c80ecad4a799ee8aa81439ae102 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072392a42c80ecad4a799ee8aa81439ae102 2023-07-23 15:08:07,018 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-23 15:08:07,021 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:07,024 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-23 15:08:07,026 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-23 15:08:07,028 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:07,028 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-23 15:08:07,028 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124887028"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:07,028 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124887028"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:07,031 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:08:07,031 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 885028b95a863aa4771088f4b9b56b6c, NAME => 'testtb-testConsecutiveExports,,1690124854268.885028b95a863aa4771088f4b9b56b6c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 73cc90ebe486fbd51234e33b01263982, NAME => 'testtb-testConsecutiveExports,1,1690124854268.73cc90ebe486fbd51234e33b01263982.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:08:07,031 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-23 15:08:07,031 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124887031"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:07,033 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-23 15:08:07,035 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 15:08:07,039 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 57 msec 2023-07-23 15:08:07,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 15:08:07,093 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-23 15:08:07,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-23 15:08:07,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-23 15:08:07,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-23 15:08:07,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-23 15:08:07,133 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 763), OpenFileDescriptor=905 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=277 (was 275) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=5974 (was 6272) 2023-07-23 15:08:07,134 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-23 15:08:07,156 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=277, ProcessCount=179, AvailableMemoryMB=5973 2023-07-23 15:08:07,156 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-23 15:08:07,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 15:08:07,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,161 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:08:07,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-23 15:08:07,162 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:08:07,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 15:08:07,165 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:07,165 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749 2023-07-23 15:08:07,165 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749 empty. 2023-07-23 15:08:07,165 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53 empty. 2023-07-23 15:08:07,166 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749 2023-07-23 15:08:07,166 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:07,166 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 15:08:07,181 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-23 15:08:07,182 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => d92869e97b743378a46db26887f7c749, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:08:07,182 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => dce52ac4702d55b35e29944c3b180e53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing d92869e97b743378a46db26887f7c749, disabling compactions & flushes 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing dce52ac4702d55b35e29944c3b180e53, disabling compactions & flushes 2023-07-23 15:08:07,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:07,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. after waiting 0 ms 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. after waiting 0 ms 2023-07-23 15:08:07,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for d92869e97b743378a46db26887f7c749: 2023-07-23 15:08:07,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for dce52ac4702d55b35e29944c3b180e53: 2023-07-23 15:08:07,208 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:08:07,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124887209"}]},"ts":"1690124887209"} 2023-07-23 15:08:07,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124887209"}]},"ts":"1690124887209"} 2023-07-23 15:08:07,218 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:08:07,219 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:08:07,220 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124887220"}]},"ts":"1690124887220"} 2023-07-23 15:08:07,221 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-23 15:08:07,226 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:08:07,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:08:07,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:08:07,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:08:07,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:08:07,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dce52ac4702d55b35e29944c3b180e53, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d92869e97b743378a46db26887f7c749, ASSIGN}] 2023-07-23 15:08:07,231 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d92869e97b743378a46db26887f7c749, ASSIGN 2023-07-23 15:08:07,231 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dce52ac4702d55b35e29944c3b180e53, ASSIGN 2023-07-23 15:08:07,232 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d92869e97b743378a46db26887f7c749, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41023,1690124809736; forceNewPlan=false, retain=false 2023-07-23 15:08:07,232 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dce52ac4702d55b35e29944c3b180e53, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1690124809802; forceNewPlan=false, retain=false 2023-07-23 15:08:07,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 15:08:07,383 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:08:07,387 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=dce52ac4702d55b35e29944c3b180e53, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d92869e97b743378a46db26887f7c749, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,387 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124887387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124887387"}]},"ts":"1690124887387"} 2023-07-23 15:08:07,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124887387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124887387"}]},"ts":"1690124887387"} 2023-07-23 15:08:07,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure dce52ac4702d55b35e29944c3b180e53, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:08:07,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure d92869e97b743378a46db26887f7c749, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:08:07,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 15:08:07,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dce52ac4702d55b35e29944c3b180e53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:08:07,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. service=AccessControlService 2023-07-23 15:08:07,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:07,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:07,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d92869e97b743378a46db26887f7c749, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:08:07,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:07,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:07,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:07,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:07,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. service=AccessControlService 2023-07-23 15:08:07,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:07,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d92869e97b743378a46db26887f7c749 2023-07-23 15:08:07,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:07,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d92869e97b743378a46db26887f7c749 2023-07-23 15:08:07,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d92869e97b743378a46db26887f7c749 2023-07-23 15:08:07,553 INFO [StoreOpener-dce52ac4702d55b35e29944c3b180e53-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:07,554 INFO [StoreOpener-d92869e97b743378a46db26887f7c749-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d92869e97b743378a46db26887f7c749 2023-07-23 15:08:07,555 DEBUG [StoreOpener-dce52ac4702d55b35e29944c3b180e53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/cf 2023-07-23 15:08:07,555 DEBUG [StoreOpener-d92869e97b743378a46db26887f7c749-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/cf 2023-07-23 15:08:07,555 DEBUG [StoreOpener-d92869e97b743378a46db26887f7c749-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/cf 2023-07-23 15:08:07,555 DEBUG [StoreOpener-dce52ac4702d55b35e29944c3b180e53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/cf 2023-07-23 15:08:07,556 INFO [StoreOpener-dce52ac4702d55b35e29944c3b180e53-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dce52ac4702d55b35e29944c3b180e53 columnFamilyName cf 2023-07-23 15:08:07,556 INFO [StoreOpener-d92869e97b743378a46db26887f7c749-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d92869e97b743378a46db26887f7c749 columnFamilyName cf 2023-07-23 15:08:07,558 INFO [StoreOpener-d92869e97b743378a46db26887f7c749-1] regionserver.HStore(310): Store=d92869e97b743378a46db26887f7c749/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:07,558 INFO [StoreOpener-dce52ac4702d55b35e29944c3b180e53-1] regionserver.HStore(310): Store=dce52ac4702d55b35e29944c3b180e53/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:07,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749 2023-07-23 15:08:07,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:07,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749 2023-07-23 15:08:07,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:07,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:07,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d92869e97b743378a46db26887f7c749 2023-07-23 15:08:07,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:07,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dce52ac4702d55b35e29944c3b180e53; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73385367, jitterRate=0.0935271829366684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:07,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dce52ac4702d55b35e29944c3b180e53: 2023-07-23 15:08:07,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53., pid=60, masterSystemTime=1690124887542 2023-07-23 15:08:07,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:07,571 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=dce52ac4702d55b35e29944c3b180e53, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d92869e97b743378a46db26887f7c749; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63895181, jitterRate=-0.04788760840892792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:07,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d92869e97b743378a46db26887f7c749: 2023-07-23 15:08:07,572 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887571"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124887571"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124887571"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124887571"}]},"ts":"1690124887571"} 2023-07-23 15:08:07,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749., pid=61, masterSystemTime=1690124887545 2023-07-23 15:08:07,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:07,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:07,575 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d92869e97b743378a46db26887f7c749, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,575 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124887575"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124887575"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124887575"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124887575"}]},"ts":"1690124887575"} 2023-07-23 15:08:07,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-23 15:08:07,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure dce52ac4702d55b35e29944c3b180e53, server=jenkins-hbase4.apache.org,42581,1690124809802 in 185 msec 2023-07-23 15:08:07,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dce52ac4702d55b35e29944c3b180e53, ASSIGN in 349 msec 2023-07-23 15:08:07,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-23 15:08:07,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure d92869e97b743378a46db26887f7c749, server=jenkins-hbase4.apache.org,41023,1690124809736 in 186 msec 2023-07-23 15:08:07,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-23 15:08:07,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d92869e97b743378a46db26887f7c749, ASSIGN in 351 msec 2023-07-23 15:08:07,581 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:08:07,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124887582"}]},"ts":"1690124887582"} 2023-07-23 15:08:07,583 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-23 15:08:07,585 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:08:07,585 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-23 15:08:07,587 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 15:08:07,589 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:07,589 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:07,589 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:07,589 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:07,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:07,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:07,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:07,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:07,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 432 msec 2023-07-23 15:08:07,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 15:08:07,766 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-23 15:08:07,769 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,769 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,772 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:07,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:07,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124887790 (current time:1690124887790). 2023-07-23 15:08:07,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:07,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x5d37669d to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:07,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@181f316b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:07,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:07,801 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:07,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d37669d to 127.0.0.1:63816 2023-07-23 15:08:07,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:07,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x755ec804 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:07,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@133b4bbc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:07,812 DEBUG [hconnection-0x72ceb4d9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:07,813 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:07,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:07,819 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:07,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x755ec804 to 127.0.0.1:63816 2023-07-23 15:08:07,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:07,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 15:08:07,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:07,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:07,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:07,824 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:07,824 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690125487824 2023-07-23 15:08:07,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:07,826 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:07,826 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:07,827 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:07,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:07,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-23 15:08:07,828 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:07,829 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690125487829 2023-07-23 15:08:07,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,841 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 15:08:07,841 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:07,842 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 15:08:07,842 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 15:08:07,843 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,843 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,844 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,844 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,844 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,844 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,848 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,848 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,849 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,849 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:07,849 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:07,849 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:07,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:07,852 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:07,852 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:07,852 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:07,852 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:07,852 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:07,854 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,854 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,854 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,855 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:07,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:07,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 15:08:07,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42a87dcc[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:07,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 15:08:07,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42a87dcc[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:07,860 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 15:08:07,860 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,862 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,862 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,862 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:07,863 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:07,863 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:07,863 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,863 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. started... 2023-07-23 15:08:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:07,863 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. started... 2023-07-23 15:08:07,863 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,863 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dce52ac4702d55b35e29944c3b180e53: 2023-07-23 15:08:07,863 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:07,865 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d92869e97b743378a46db26887f7c749: 2023-07-23 15:08:07,865 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:08:07,865 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,865 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,865 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:07,865 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:07,865 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:07,865 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:07,880 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. completed. 2023-07-23 15:08:07,880 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:07,880 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:07,880 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. completed. 2023-07-23 15:08:07,880 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:07,880 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:07,880 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:07,881 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:07,881 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,880 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,881 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:07,881 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:07,881 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:08:07,881 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:08:07,882 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:07,882 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:07,882 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,882 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:07,882 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,882 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:07,882 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,883 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:08:07,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 15:08:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42581,1690124809802': 2023-07-23 15:08:07,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 15:08:07,899 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 15:08:07,899 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:07,899 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:07,899 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,899 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:07,903 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:07,903 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:07,903 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,906 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:07,906 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:07,908 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,909 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,909 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:07,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,913 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:07,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,913 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:07,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:07,912 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:07,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:08:07,913 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:07,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:07,915 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:07,915 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:07,915 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:07,915 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,915 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 15:08:07,927 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:07,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 15:08:07,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:07,929 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:07,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:07,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,129 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:08,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 15:08:08,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:08,130 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:08:08,378 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 15:08:08,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,378 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690124887824Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690124887930 (+106 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690124887930Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690124887930Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690124887933 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690124887947 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690124888378 (+431 ms) 2023-07-23 15:08:08,382 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:08,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 557 msec 2023-07-23 15:08:08,431 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:08,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 15:08:08,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:08,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:08,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41023] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:08,438 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,438 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:08,438 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:08,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:08,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124888448 (current time:1690124888448). 2023-07-23 15:08:08,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:08,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x58395771 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:08,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e76f613, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:08,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:08,458 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:08,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58395771 to 127.0.0.1:63816 2023-07-23 15:08:08,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:08,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x59903307 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:08,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b80759b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:08,466 DEBUG [hconnection-0x129fd496-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:08,469 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:08,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:08,474 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:08,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59903307 to 127.0.0.1:63816 2023-07-23 15:08:08,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:08,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 15:08:08,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:08,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:08,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:08,478 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:08,479 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690125488479 2023-07-23 15:08:08,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 15:08:08,480 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:08,480 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:08,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:08,481 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 15:08:08,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-07-23 15:08:08,483 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:08,484 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690125488484 2023-07-23 15:08:08,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,491 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 15:08:08,491 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:08,492 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 15:08:08,492 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 15:08:08,493 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,493 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,494 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,494 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,494 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,494 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,494 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,494 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,495 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,495 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:08,495 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 15:08:08,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:08,497 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:08,497 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:08,497 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:08,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,497 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:08,497 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:08,497 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 15:08:08,498 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:08,498 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:08,498 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:08,498 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:08,499 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 15:08:08,499 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 15:08:08,499 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 15:08:08,500 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,505 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,505 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,505 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,505 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,505 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,506 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,506 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:08,506 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,506 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:08,506 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 15:08:08,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1685a0a[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:08,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 15:08:08,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1685a0a[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:08,510 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 15:08:08,510 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,511 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:08,511 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:08,511 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:08,511 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:08,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. started... 2023-07-23 15:08:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,511 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:08,511 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 15:08:08,512 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:08:08,511 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,512 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d92869e97b743378a46db26887f7c749 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-23 15:08:08,512 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:08,512 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:08,512 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:08,512 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. started... 2023-07-23 15:08:08,512 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:08,512 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dce52ac4702d55b35e29944c3b180e53 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-23 15:08:08,513 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:08,513 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:08,513 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:08,528 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072348b34afca4a64283944666da8807a572 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072348b34afca4a64283944666da8807a572 2023-07-23 15:08:08,528 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307239b4be8e957f94e6fa874c99aae720004 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307239b4be8e957f94e6fa874c99aae720004 2023-07-23 15:08:08,539 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/.tmp/cf/9fb54f1acf4c4f9d9e08b70423b5311f 2023-07-23 15:08:08,539 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/.tmp/cf/062df45bfb9f480d82e12740eba87fcb 2023-07-23 15:08:08,544 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/.tmp/cf/9fb54f1acf4c4f9d9e08b70423b5311f as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/cf/9fb54f1acf4c4f9d9e08b70423b5311f 2023-07-23 15:08:08,544 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/.tmp/cf/062df45bfb9f480d82e12740eba87fcb as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/cf/062df45bfb9f480d82e12740eba87fcb 2023-07-23 15:08:08,550 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/cf/9fb54f1acf4c4f9d9e08b70423b5311f, entries=45, sequenceid=6, filesize=13.2 K 2023-07-23 15:08:08,550 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/cf/062df45bfb9f480d82e12740eba87fcb, entries=5, sequenceid=6, filesize=5.8 K 2023-07-23 15:08:08,551 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for d92869e97b743378a46db26887f7c749 in 39ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:08,551 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-23 15:08:08,551 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for dce52ac4702d55b35e29944c3b180e53 in 39ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:08,551 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-23 15:08:08,551 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d92869e97b743378a46db26887f7c749: 2023-07-23 15:08:08,553 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dce52ac4702d55b35e29944c3b180e53: 2023-07-23 15:08:08,553 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,553 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,553 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:08,553 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:08,553 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/cf/9fb54f1acf4c4f9d9e08b70423b5311f] hfiles 2023-07-23 15:08:08,553 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/cf/062df45bfb9f480d82e12740eba87fcb] hfiles 2023-07-23 15:08:08,553 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/cf/9fb54f1acf4c4f9d9e08b70423b5311f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,554 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/cf/062df45bfb9f480d82e12740eba87fcb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,569 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. completed. 2023-07-23 15:08:08,569 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:08,569 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:08,569 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:08,570 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,570 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:08,570 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:08:08,574 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,574 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. completed. 2023-07-23 15:08:08,574 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 15:08:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:08:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,577 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,577 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 15:08:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,578 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:08,578 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 15:08:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,580 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42581,1690124809802': 2023-07-23 15:08:08,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 15:08:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 15:08:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:08,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,582 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:08,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:08:08,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 15:08:08,584 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 15:08:08,584 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:08,584 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:08,584 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,584 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:08,589 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,589 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:08,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:08,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,589 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,589 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,589 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,590 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,590 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:08,590 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,591 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:08,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,591 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:08,593 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,593 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,593 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,596 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,596 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,596 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,596 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,596 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,596 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:08,596 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:08,597 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,597 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,596 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,596 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,597 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,597 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,596 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:08,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,597 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:08,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:08:08,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:08,597 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,598 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:08,598 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:08,598 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,598 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:08,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307239b4be8e957f94e6fa874c99aae720004, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072348b34afca4a64283944666da8807a572] mob files 2023-07-23 15:08:08,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307239b4be8e957f94e6fa874c99aae720004 2023-07-23 15:08:08,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072348b34afca4a64283944666da8807a572 2023-07-23 15:08:08,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 15:08:08,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,667 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:08,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690124888479Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690124888629 (+150 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690124888629Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690124888629Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690124888632 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690124888642 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690124888667 (+25 ms) 2023-07-23 15:08:08,669 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 15:08:08,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 189 msec 2023-07-23 15:08:08,782 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:08,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 15:08:08,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:08,820 DEBUG [Listener at jenkins-hbase4.apache.org/42857] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:08:08,824 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:08:08,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38883] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 15:08:08,827 DEBUG [Listener at jenkins-hbase4.apache.org/42857] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:08:08,830 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:08:08,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41023] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 15:08:08,831 DEBUG [Listener at jenkins-hbase4.apache.org/42857] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 15:08:08,836 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 15:08:08,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 15:08:08,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 15:08:08,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:08,841 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:08:08,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-23 15:08:08,842 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:08:08,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 15:08:08,844 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:08,844 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:08,845 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01 empty. 2023-07-23 15:08:08,845 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51 empty. 2023-07-23 15:08:08,845 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:08,845 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:08,845 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 15:08:08,855 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-23 15:08:08,856 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6b7e2dddf2468453bd811a402a127b51, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:08:08,857 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 414c939878f6107a5be0b8c1e3c9ca01, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:08:08,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:08,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 414c939878f6107a5be0b8c1e3c9ca01, disabling compactions & flushes 2023-07-23 15:08:08,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:08,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:08,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. after waiting 0 ms 2023-07-23 15:08:08,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:08,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:08,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 414c939878f6107a5be0b8c1e3c9ca01: 2023-07-23 15:08:08,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:08,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 6b7e2dddf2468453bd811a402a127b51, disabling compactions & flushes 2023-07-23 15:08:08,875 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:08,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:08,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. after waiting 0 ms 2023-07-23 15:08:08,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:08,875 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:08,875 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 6b7e2dddf2468453bd811a402a127b51: 2023-07-23 15:08:08,877 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:08:08,878 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124888878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124888878"}]},"ts":"1690124888878"} 2023-07-23 15:08:08,878 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124888878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124888878"}]},"ts":"1690124888878"} 2023-07-23 15:08:08,880 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:08:08,881 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:08:08,881 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124888881"}]},"ts":"1690124888881"} 2023-07-23 15:08:08,882 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-23 15:08:08,885 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:08:08,886 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:08:08,886 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:08:08,886 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:08:08,886 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:08:08,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b7e2dddf2468453bd811a402a127b51, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=414c939878f6107a5be0b8c1e3c9ca01, ASSIGN}] 2023-07-23 15:08:08,888 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=414c939878f6107a5be0b8c1e3c9ca01, ASSIGN 2023-07-23 15:08:08,889 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b7e2dddf2468453bd811a402a127b51, ASSIGN 2023-07-23 15:08:08,889 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=414c939878f6107a5be0b8c1e3c9ca01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1690124809802; forceNewPlan=false, retain=false 2023-07-23 15:08:08,889 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b7e2dddf2468453bd811a402a127b51, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38883,1690124809666; forceNewPlan=false, retain=false 2023-07-23 15:08:08,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 15:08:09,040 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:08:09,042 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6b7e2dddf2468453bd811a402a127b51, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:09,042 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=414c939878f6107a5be0b8c1e3c9ca01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:09,043 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889042"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124889042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124889042"}]},"ts":"1690124889042"} 2023-07-23 15:08:09,043 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889042"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124889042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124889042"}]},"ts":"1690124889042"} 2023-07-23 15:08:09,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 6b7e2dddf2468453bd811a402a127b51, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:08:09,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 414c939878f6107a5be0b8c1e3c9ca01, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:08:09,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 15:08:09,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:09,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:09,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6b7e2dddf2468453bd811a402a127b51, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.', STARTKEY => '', ENDKEY => '2'} 2023-07-23 15:08:09,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 414c939878f6107a5be0b8c1e3c9ca01, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.', STARTKEY => '2', ENDKEY => ''} 2023-07-23 15:08:09,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. service=AccessControlService 2023-07-23 15:08:09,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. service=AccessControlService 2023-07-23 15:08:09,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:09,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:09,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:09,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:09,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:09,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:09,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:09,203 INFO [StoreOpener-6b7e2dddf2468453bd811a402a127b51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:09,204 INFO [StoreOpener-414c939878f6107a5be0b8c1e3c9ca01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,205 DEBUG [StoreOpener-6b7e2dddf2468453bd811a402a127b51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/cf 2023-07-23 15:08:09,205 DEBUG [StoreOpener-6b7e2dddf2468453bd811a402a127b51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/cf 2023-07-23 15:08:09,206 INFO [StoreOpener-6b7e2dddf2468453bd811a402a127b51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b7e2dddf2468453bd811a402a127b51 columnFamilyName cf 2023-07-23 15:08:09,206 DEBUG [StoreOpener-414c939878f6107a5be0b8c1e3c9ca01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/cf 2023-07-23 15:08:09,206 DEBUG [StoreOpener-414c939878f6107a5be0b8c1e3c9ca01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/cf 2023-07-23 15:08:09,206 INFO [StoreOpener-414c939878f6107a5be0b8c1e3c9ca01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 414c939878f6107a5be0b8c1e3c9ca01 columnFamilyName cf 2023-07-23 15:08:09,207 INFO [StoreOpener-6b7e2dddf2468453bd811a402a127b51-1] regionserver.HStore(310): Store=6b7e2dddf2468453bd811a402a127b51/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:09,208 INFO [StoreOpener-414c939878f6107a5be0b8c1e3c9ca01-1] regionserver.HStore(310): Store=414c939878f6107a5be0b8c1e3c9ca01/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:09,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:09,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:09,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:09,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:09,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6b7e2dddf2468453bd811a402a127b51; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62753073, jitterRate=-0.06490634381771088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:09,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6b7e2dddf2468453bd811a402a127b51: 2023-07-23 15:08:09,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:09,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 414c939878f6107a5be0b8c1e3c9ca01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71194642, jitterRate=0.06088283658027649}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:09,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 414c939878f6107a5be0b8c1e3c9ca01: 2023-07-23 15:08:09,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51., pid=69, masterSystemTime=1690124889196 2023-07-23 15:08:09,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01., pid=70, masterSystemTime=1690124889197 2023-07-23 15:08:09,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:09,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:09,219 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6b7e2dddf2468453bd811a402a127b51, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:09,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:09,219 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889219"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124889219"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124889219"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124889219"}]},"ts":"1690124889219"} 2023-07-23 15:08:09,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:09,220 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=414c939878f6107a5be0b8c1e3c9ca01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:09,220 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889220"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124889220"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124889220"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124889220"}]},"ts":"1690124889220"} 2023-07-23 15:08:09,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-23 15:08:09,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 6b7e2dddf2468453bd811a402a127b51, server=jenkins-hbase4.apache.org,38883,1690124809666 in 178 msec 2023-07-23 15:08:09,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-23 15:08:09,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 414c939878f6107a5be0b8c1e3c9ca01, server=jenkins-hbase4.apache.org,42581,1690124809802 in 178 msec 2023-07-23 15:08:09,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b7e2dddf2468453bd811a402a127b51, ASSIGN in 338 msec 2023-07-23 15:08:09,236 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-23 15:08:09,236 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=414c939878f6107a5be0b8c1e3c9ca01, ASSIGN in 340 msec 2023-07-23 15:08:09,237 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:08:09,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124889237"}]},"ts":"1690124889237"} 2023-07-23 15:08:09,239 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-23 15:08:09,242 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:08:09,243 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-23 15:08:09,245 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 15:08:09,246 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:09,246 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:09,246 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:09,246 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:09,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:09,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:09,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:09,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:09,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:09,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:09,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:09,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:09,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 411 msec 2023-07-23 15:08:09,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 15:08:09,446 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-23 15:08:09,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 6b7e2dddf2468453bd811a402a127b51, 414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6b7e2dddf2468453bd811a402a127b51, 414c939878f6107a5be0b8c1e3c9ca01], force=true 2023-07-23 15:08:09,478 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6b7e2dddf2468453bd811a402a127b51, 414c939878f6107a5be0b8c1e3c9ca01], force=true 2023-07-23 15:08:09,478 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6b7e2dddf2468453bd811a402a127b51, 414c939878f6107a5be0b8c1e3c9ca01], force=true 2023-07-23 15:08:09,478 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6b7e2dddf2468453bd811a402a127b51, 414c939878f6107a5be0b8c1e3c9ca01], force=true 2023-07-23 15:08:09,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:09,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b7e2dddf2468453bd811a402a127b51, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=414c939878f6107a5be0b8c1e3c9ca01, UNASSIGN}] 2023-07-23 15:08:09,506 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b7e2dddf2468453bd811a402a127b51, UNASSIGN 2023-07-23 15:08:09,506 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=414c939878f6107a5be0b8c1e3c9ca01, UNASSIGN 2023-07-23 15:08:09,507 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6b7e2dddf2468453bd811a402a127b51, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:09,507 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=414c939878f6107a5be0b8c1e3c9ca01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:09,507 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124889507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124889507"}]},"ts":"1690124889507"} 2023-07-23 15:08:09,507 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124889507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124889507"}]},"ts":"1690124889507"} 2023-07-23 15:08:09,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 414c939878f6107a5be0b8c1e3c9ca01, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:08:09,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 6b7e2dddf2468453bd811a402a127b51, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:08:09,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:09,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 414c939878f6107a5be0b8c1e3c9ca01, disabling compactions & flushes 2023-07-23 15:08:09,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:09,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:09,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. after waiting 0 ms 2023-07-23 15:08:09,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:09,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 414c939878f6107a5be0b8c1e3c9ca01 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 15:08:09,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:09,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6b7e2dddf2468453bd811a402a127b51, disabling compactions & flushes 2023-07-23 15:08:09,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:09,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:09,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. after waiting 0 ms 2023-07-23 15:08:09,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:09,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6b7e2dddf2468453bd811a402a127b51 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 15:08:09,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/.tmp/cf/93c2425ff19d4adcb1e1fc11f71e4b20 2023-07-23 15:08:09,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/.tmp/cf/53f75fed21f44db2bbfcb0ac5a682292 2023-07-23 15:08:09,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/.tmp/cf/53f75fed21f44db2bbfcb0ac5a682292 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/cf/53f75fed21f44db2bbfcb0ac5a682292 2023-07-23 15:08:09,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/.tmp/cf/93c2425ff19d4adcb1e1fc11f71e4b20 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/cf/93c2425ff19d4adcb1e1fc11f71e4b20 2023-07-23 15:08:09,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/cf/53f75fed21f44db2bbfcb0ac5a682292, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 15:08:09,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/cf/93c2425ff19d4adcb1e1fc11f71e4b20, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 15:08:09,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 414c939878f6107a5be0b8c1e3c9ca01 in 54ms, sequenceid=5, compaction requested=false 2023-07-23 15:08:09,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 15:08:09,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6b7e2dddf2468453bd811a402a127b51 in 53ms, sequenceid=5, compaction requested=false 2023-07-23 15:08:09,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 15:08:09,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 15:08:09,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 15:08:09,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:09,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:09,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01. 2023-07-23 15:08:09,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51. 2023-07-23 15:08:09,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 414c939878f6107a5be0b8c1e3c9ca01: 2023-07-23 15:08:09,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6b7e2dddf2468453bd811a402a127b51: 2023-07-23 15:08:09,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:09,731 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6b7e2dddf2468453bd811a402a127b51, regionState=CLOSED 2023-07-23 15:08:09,731 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124889731"}]},"ts":"1690124889731"} 2023-07-23 15:08:09,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:09,731 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=414c939878f6107a5be0b8c1e3c9ca01, regionState=CLOSED 2023-07-23 15:08:09,731 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690124889731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124889731"}]},"ts":"1690124889731"} 2023-07-23 15:08:09,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-23 15:08:09,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 6b7e2dddf2468453bd811a402a127b51, server=jenkins-hbase4.apache.org,38883,1690124809666 in 223 msec 2023-07-23 15:08:09,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-23 15:08:09,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 414c939878f6107a5be0b8c1e3c9ca01, server=jenkins-hbase4.apache.org,42581,1690124809802 in 225 msec 2023-07-23 15:08:09,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b7e2dddf2468453bd811a402a127b51, UNASSIGN in 235 msec 2023-07-23 15:08:09,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-23 15:08:09,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=414c939878f6107a5be0b8c1e3c9ca01, UNASSIGN in 233 msec 2023-07-23 15:08:09,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:09,800 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-23 15:08:09,802 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888838.6b7e2dddf2468453bd811a402a127b51.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:09,802 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690124888838.414c939878f6107a5be0b8c1e3c9ca01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:09,802 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:09,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87af4edf5c8a04b58095d7342d672726, ASSIGN}] 2023-07-23 15:08:09,852 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87af4edf5c8a04b58095d7342d672726, ASSIGN 2023-07-23 15:08:09,853 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87af4edf5c8a04b58095d7342d672726, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,38883,1690124809666; forceNewPlan=false, retain=false 2023-07-23 15:08:10,004 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 15:08:10,005 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=87af4edf5c8a04b58095d7342d672726, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690124890005"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124890005"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124890005"}]},"ts":"1690124890005"} 2023-07-23 15:08:10,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 87af4edf5c8a04b58095d7342d672726, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:08:10,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:10,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. 2023-07-23 15:08:10,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87af4edf5c8a04b58095d7342d672726, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.', STARTKEY => '', ENDKEY => ''} 2023-07-23 15:08:10,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. service=AccessControlService 2023-07-23 15:08:10,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:10,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:10,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:10,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:10,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:10,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/.regioninfo 2023-07-23 15:08:10,204 INFO [StoreOpener-87af4edf5c8a04b58095d7342d672726-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:10,205 DEBUG [StoreOpener-87af4edf5c8a04b58095d7342d672726-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf 2023-07-23 15:08:10,205 DEBUG [StoreOpener-87af4edf5c8a04b58095d7342d672726-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf 2023-07-23 15:08:10,206 INFO [StoreOpener-87af4edf5c8a04b58095d7342d672726-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87af4edf5c8a04b58095d7342d672726 columnFamilyName cf 2023-07-23 15:08:10,237 DEBUG [StoreOpener-87af4edf5c8a04b58095d7342d672726-1] regionserver.HStore(539): loaded hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/53f75fed21f44db2bbfcb0ac5a682292.414c939878f6107a5be0b8c1e3c9ca01->hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/cf/53f75fed21f44db2bbfcb0ac5a682292-top 2023-07-23 15:08:10,244 DEBUG [StoreOpener-87af4edf5c8a04b58095d7342d672726-1] regionserver.HStore(539): loaded hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/93c2425ff19d4adcb1e1fc11f71e4b20.6b7e2dddf2468453bd811a402a127b51->hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/cf/93c2425ff19d4adcb1e1fc11f71e4b20-top 2023-07-23 15:08:10,245 INFO [StoreOpener-87af4edf5c8a04b58095d7342d672726-1] regionserver.HStore(310): Store=87af4edf5c8a04b58095d7342d672726/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:10,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:10,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:10,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:10,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87af4edf5c8a04b58095d7342d672726; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65697578, jitterRate=-0.021029800176620483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:10,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87af4edf5c8a04b58095d7342d672726: 2023-07-23 15:08:10,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726., pid=77, masterSystemTime=1690124890158 2023-07-23 15:08:10,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.,because compaction is disabled. 2023-07-23 15:08:10,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. 2023-07-23 15:08:10,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. 2023-07-23 15:08:10,256 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=87af4edf5c8a04b58095d7342d672726, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,256 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690124890256"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124890256"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124890256"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124890256"}]},"ts":"1690124890256"} 2023-07-23 15:08:10,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-23 15:08:10,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 87af4edf5c8a04b58095d7342d672726, server=jenkins-hbase4.apache.org,38883,1690124809666 in 251 msec 2023-07-23 15:08:10,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-23 15:08:10,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87af4edf5c8a04b58095d7342d672726, ASSIGN in 408 msec 2023-07-23 15:08:10,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6b7e2dddf2468453bd811a402a127b51, 414c939878f6107a5be0b8c1e3c9ca01], force=true in 791 msec 2023-07-23 15:08:10,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 15:08:10,586 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-23 15:08:10,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 15:08:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124890587 (current time:1690124890587). 2023-07-23 15:08:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:10,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x3804bf7f to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:10,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@438f1a50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:10,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:10,601 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:10,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3804bf7f to 127.0.0.1:63816 2023-07-23 15:08:10,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:10,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x3bcf319c to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:10,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@262d8edd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:10,620 DEBUG [hconnection-0x1d4b4dd2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:10,623 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:10,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:10,630 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:10,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bcf319c to 127.0.0.1:63816 2023-07-23 15:08:10,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:10,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 15:08:10,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:10,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 15:08:10,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 15:08:10,635 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 15:08:10,635 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690125490635 2023-07-23 15:08:10,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 15:08:10,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,639 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:10,639 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:10,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 15:08:10,640 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 15:08:10,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-07-23 15:08:10,642 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 15:08:10,643 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690125490643 2023-07-23 15:08:10,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,687 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 15:08:10,687 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:10,688 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-23 15:08:10,688 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-23 15:08:10,689 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,689 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,690 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,690 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,690 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,690 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,691 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,691 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 15:08:10,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,693 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 15:08:10,693 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:10,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,693 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 15:08:10,693 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 15:08:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 15:08:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 15:08:10,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 15:08:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 15:08:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 15:08:10,698 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 15:08:10,698 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 15:08:10,698 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 15:08:10,698 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 15:08:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,710 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:10,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,711 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:10,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:10,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:10,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:10,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:10,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-23 15:08:10,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58869768[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:10,713 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-23 15:08:10,713 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,714 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,714 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,714 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,715 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 15:08:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 15:08:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:08:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 15:08:10,717 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,718 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 15:08:10,718 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,718 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,718 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:10,718 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:10,718 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 15:08:10,718 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 15:08:10,718 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 15:08:10,718 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:08:10,719 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:10,721 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:10,721 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. 2023-07-23 15:08:10,721 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. started... 2023-07-23 15:08:10,723 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87af4edf5c8a04b58095d7342d672726: 2023-07-23 15:08:10,723 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 15:08:10,723 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:10,723 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,723 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 15:08:10,728 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:10,730 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/53f75fed21f44db2bbfcb0ac5a682292.414c939878f6107a5be0b8c1e3c9ca01->hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/cf/53f75fed21f44db2bbfcb0ac5a682292-top, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/93c2425ff19d4adcb1e1fc11f71e4b20.6b7e2dddf2468453bd811a402a127b51->hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/cf/93c2425ff19d4adcb1e1fc11f71e4b20-top] hfiles 2023-07-23 15:08:10,730 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/53f75fed21f44db2bbfcb0ac5a682292.414c939878f6107a5be0b8c1e3c9ca01 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,730 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/93c2425ff19d4adcb1e1fc11f71e4b20.6b7e2dddf2468453bd811a402a127b51 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,740 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:10,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 15:08:10,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:10,742 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:10,757 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. completed. 2023-07-23 15:08:10,757 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. 2023-07-23 15:08:10,757 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:10,758 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:10,758 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,758 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 15:08:10,758 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:08:10,763 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,763 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 15:08:10,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:10,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:10,763 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:10,763 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 15:08:10,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:10,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:10,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:10,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:10,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:10,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:10,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:10,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,38883,1690124809666': 2023-07-23 15:08:10,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-23 15:08:10,769 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-23 15:08:10,769 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:10,769 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:10,769 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,769 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:10,771 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,771 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,771 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,771 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,771 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,771 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,771 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:10,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:10,772 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:10,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,772 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:10,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,773 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:10,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:10,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:10,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:10,776 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:10,776 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:10,777 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:10,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:10,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:10,787 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:10,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,788 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:10,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:10,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:10,788 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,789 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:10,789 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:10,789 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,789 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,794 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:10,794 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:10,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:10,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:10,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-23 15:08:10,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,891 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690124890636Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690124890788 (+152 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690124890788Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690124890793 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690124890825 (+32 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690124890891 (+66 ms) 2023-07-23 15:08:10,895 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 15:08:10,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 256 msec 2023-07-23 15:08:10,942 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:10,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 15:08:10,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:10,944 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944 2023-07-23 15:08:10,944 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44181, tgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944, rawTgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944, srcFsUri=hdfs://localhost:44181, srcDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:08:10,977 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:08:10,978 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_866969849_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:10,978 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661, snapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-23 15:08:10,990 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:11,040 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,040 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,041 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,041 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,041 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,042 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,042 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,125 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop-2782907338596962509.jar 2023-07-23 15:08:11,125 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,126 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,126 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,126 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,127 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,127 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:11,128 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:08:11,128 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:08:11,129 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:08:11,130 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:08:11,130 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:08:11,131 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:08:11,132 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:08:11,132 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:08:11,132 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:08:11,133 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:08:11,134 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:11,134 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:11,134 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:11,135 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:11,135 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:11,136 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:11,136 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:11,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0004_000001 (auth:SIMPLE) 2023-07-23 15:08:11,698 WARN [Listener at jenkins-hbase4.apache.org/42857] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:08:11,701 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-23 15:08:11,704 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-23 15:08:11,781 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:11,781 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:12,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:12,440 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:08:19,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:21,715 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:25,020 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:26,942 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:08:26,942 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:08:26,960 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:26,960 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:08:26,961 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:08:26,961 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:26,962 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 15:08:26,962 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 15:08:26,962 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:26,963 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 15:08:26,963 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124890944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 15:08:26,974 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:26,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:26,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:26,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 15:08:26,982 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124906982"}]},"ts":"1690124906982"} 2023-07-23 15:08:26,983 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-23 15:08:26,985 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-23 15:08:26,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87af4edf5c8a04b58095d7342d672726, UNASSIGN}] 2023-07-23 15:08:26,988 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87af4edf5c8a04b58095d7342d672726, UNASSIGN 2023-07-23 15:08:26,989 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=87af4edf5c8a04b58095d7342d672726, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:26,989 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690124906989"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124906989"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124906989"}]},"ts":"1690124906989"} 2023-07-23 15:08:26,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 87af4edf5c8a04b58095d7342d672726, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:08:27,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 15:08:27,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87af4edf5c8a04b58095d7342d672726, disabling compactions & flushes 2023-07-23 15:08:27,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. 2023-07-23 15:08:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. 2023-07-23 15:08:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. after waiting 0 ms 2023-07-23 15:08:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. 2023-07-23 15:08:27,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-23 15:08:27,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:27,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726. 2023-07-23 15:08:27,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87af4edf5c8a04b58095d7342d672726: 2023-07-23 15:08:27,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:27,174 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=87af4edf5c8a04b58095d7342d672726, regionState=CLOSED 2023-07-23 15:08:27,174 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690124907174"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124907174"}]},"ts":"1690124907174"} 2023-07-23 15:08:27,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-23 15:08:27,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 87af4edf5c8a04b58095d7342d672726, server=jenkins-hbase4.apache.org,38883,1690124809666 in 185 msec 2023-07-23 15:08:27,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-23 15:08:27,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87af4edf5c8a04b58095d7342d672726, UNASSIGN in 190 msec 2023-07-23 15:08:27,179 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124907179"}]},"ts":"1690124907179"} 2023-07-23 15:08:27,180 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-23 15:08:27,182 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-23 15:08:27,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 207 msec 2023-07-23 15:08:27,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 15:08:27,285 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-23 15:08:27,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,291 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,292 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,293 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,297 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,297 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,297 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,297 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,297 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 15:08:27,297 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 15:08:27,297 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 15:08:27,297 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 15:08:27,302 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,302 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,302 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,302 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:27,302 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,302 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:27,302 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:27,302 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:27,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:27,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:27,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:27,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:27,305 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:27,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 15:08:27,306 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:27,307 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:27,308 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/recovered.edits] 2023-07-23 15:08:27,310 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/recovered.edits] 2023-07-23 15:08:27,310 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/recovered.edits] 2023-07-23 15:08:27,314 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/53f75fed21f44db2bbfcb0ac5a682292.414c939878f6107a5be0b8c1e3c9ca01 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/53f75fed21f44db2bbfcb0ac5a682292.414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:27,315 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/cf/53f75fed21f44db2bbfcb0ac5a682292 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/cf/53f75fed21f44db2bbfcb0ac5a682292 2023-07-23 15:08:27,317 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/93c2425ff19d4adcb1e1fc11f71e4b20.6b7e2dddf2468453bd811a402a127b51 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/cf/93c2425ff19d4adcb1e1fc11f71e4b20.6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:27,317 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/cf/93c2425ff19d4adcb1e1fc11f71e4b20 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/cf/93c2425ff19d4adcb1e1fc11f71e4b20 2023-07-23 15:08:27,323 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/recovered.edits/8.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01/recovered.edits/8.seqid 2023-07-23 15:08:27,323 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/414c939878f6107a5be0b8c1e3c9ca01 2023-07-23 15:08:27,323 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/recovered.edits/12.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726/recovered.edits/12.seqid 2023-07-23 15:08:27,324 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87af4edf5c8a04b58095d7342d672726 2023-07-23 15:08:27,324 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/recovered.edits/8.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51/recovered.edits/8.seqid 2023-07-23 15:08:27,325 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b7e2dddf2468453bd811a402a127b51 2023-07-23 15:08:27,325 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 15:08:27,335 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,338 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-23 15:08:27,340 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-23 15:08:27,341 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,341 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-23 15:08:27,342 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124907341"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:27,343 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-23 15:08:27,344 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87af4edf5c8a04b58095d7342d672726, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690124888839.87af4edf5c8a04b58095d7342d672726.', STARTKEY => '', ENDKEY => ''}] 2023-07-23 15:08:27,344 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-23 15:08:27,344 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124907344"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:27,351 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-23 15:08:27,353 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 67 msec 2023-07-23 15:08:27,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 15:08:27,407 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-23 15:08:27,407 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 15:08:27,413 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124907413"}]},"ts":"1690124907413"} 2023-07-23 15:08:27,415 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-23 15:08:27,417 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-23 15:08:27,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dce52ac4702d55b35e29944c3b180e53, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d92869e97b743378a46db26887f7c749, UNASSIGN}] 2023-07-23 15:08:27,420 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d92869e97b743378a46db26887f7c749, UNASSIGN 2023-07-23 15:08:27,420 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dce52ac4702d55b35e29944c3b180e53, UNASSIGN 2023-07-23 15:08:27,421 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=dce52ac4702d55b35e29944c3b180e53, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:27,421 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d92869e97b743378a46db26887f7c749, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:27,421 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124907421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124907421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124907421"}]},"ts":"1690124907421"} 2023-07-23 15:08:27,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124907421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124907421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124907421"}]},"ts":"1690124907421"} 2023-07-23 15:08:27,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure d92869e97b743378a46db26887f7c749, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:08:27,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure dce52ac4702d55b35e29944c3b180e53, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:08:27,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 15:08:27,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d92869e97b743378a46db26887f7c749 2023-07-23 15:08:27,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:27,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d92869e97b743378a46db26887f7c749, disabling compactions & flushes 2023-07-23 15:08:27,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dce52ac4702d55b35e29944c3b180e53, disabling compactions & flushes 2023-07-23 15:08:27,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:27,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:27,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:27,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:27,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. after waiting 0 ms 2023-07-23 15:08:27,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. after waiting 0 ms 2023-07-23 15:08:27,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:27,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:27,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:27,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:27,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53. 2023-07-23 15:08:27,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dce52ac4702d55b35e29944c3b180e53: 2023-07-23 15:08:27,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:27,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:27,601 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=dce52ac4702d55b35e29944c3b180e53, regionState=CLOSED 2023-07-23 15:08:27,601 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124907601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124907601"}]},"ts":"1690124907601"} 2023-07-23 15:08:27,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-23 15:08:27,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure dce52ac4702d55b35e29944c3b180e53, server=jenkins-hbase4.apache.org,42581,1690124809802 in 178 msec 2023-07-23 15:08:27,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dce52ac4702d55b35e29944c3b180e53, UNASSIGN in 186 msec 2023-07-23 15:08:27,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:27,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749. 2023-07-23 15:08:27,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d92869e97b743378a46db26887f7c749: 2023-07-23 15:08:27,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d92869e97b743378a46db26887f7c749 2023-07-23 15:08:27,608 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d92869e97b743378a46db26887f7c749, regionState=CLOSED 2023-07-23 15:08:27,608 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690124907608"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124907608"}]},"ts":"1690124907608"} 2023-07-23 15:08:27,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-23 15:08:27,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure d92869e97b743378a46db26887f7c749, server=jenkins-hbase4.apache.org,41023,1690124809736 in 186 msec 2023-07-23 15:08:27,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-23 15:08:27,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d92869e97b743378a46db26887f7c749, UNASSIGN in 193 msec 2023-07-23 15:08:27,613 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124907613"}]},"ts":"1690124907613"} 2023-07-23 15:08:27,618 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-23 15:08:27,619 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-23 15:08:27,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 212 msec 2023-07-23 15:08:27,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 15:08:27,715 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-23 15:08:27,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,721 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,722 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,723 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,726 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,726 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,726 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,726 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 15:08:27,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 15:08:27,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 15:08:27,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 15:08:27,728 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,728 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:27,729 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:27,729 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749 2023-07-23 15:08:27,730 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,730 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:27,730 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,731 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:27,731 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,731 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:27,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 15:08:27,732 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/recovered.edits] 2023-07-23 15:08:27,733 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/recovered.edits] 2023-07-23 15:08:27,741 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/cf/062df45bfb9f480d82e12740eba87fcb to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/cf/062df45bfb9f480d82e12740eba87fcb 2023-07-23 15:08:27,741 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/cf/9fb54f1acf4c4f9d9e08b70423b5311f to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/cf/9fb54f1acf4c4f9d9e08b70423b5311f 2023-07-23 15:08:27,746 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749/recovered.edits/9.seqid 2023-07-23 15:08:27,748 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53/recovered.edits/9.seqid 2023-07-23 15:08:27,748 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d92869e97b743378a46db26887f7c749 2023-07-23 15:08:27,748 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dce52ac4702d55b35e29944c3b180e53 2023-07-23 15:08:27,749 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 15:08:27,750 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-23 15:08:27,754 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-23 15:08:27,760 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307239b4be8e957f94e6fa874c99aae720004 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307239b4be8e957f94e6fa874c99aae720004 2023-07-23 15:08:27,762 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072348b34afca4a64283944666da8807a572 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072348b34afca4a64283944666da8807a572 2023-07-23 15:08:27,762 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-23 15:08:27,766 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,777 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-23 15:08:27,781 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-23 15:08:27,784 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,784 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-23 15:08:27,785 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124907785"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:27,785 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124907785"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:27,787 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:08:27,787 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dce52ac4702d55b35e29944c3b180e53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690124887157.dce52ac4702d55b35e29944c3b180e53.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d92869e97b743378a46db26887f7c749, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690124887157.d92869e97b743378a46db26887f7c749.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:08:27,787 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-23 15:08:27,787 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124907787"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:27,789 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-23 15:08:27,792 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 75 msec 2023-07-23 15:08:27,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 15:08:27,840 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-23 15:08:27,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 15:08:27,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 15:08:27,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 15:08:27,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-23 15:08:27,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 15:08:27,897 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756 (was 746) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:52846 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:38512 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:45803 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:58068 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3990 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1609317452_1 at /127.0.0.1:38486 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=364 (was 277) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=5266 (was 5973) 2023-07-23 15:08:27,898 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-23 15:08:27,929 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=756, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=364, ProcessCount=181, AvailableMemoryMB=5262 2023-07-23 15:08:27,929 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-23 15:08:27,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 15:08:27,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:27,935 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:08:27,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-23 15:08:27,935 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:08:27,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 15:08:27,938 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:27,938 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:27,938 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7 empty. 2023-07-23 15:08:27,938 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7 empty. 2023-07-23 15:08:27,939 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:27,939 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:27,939 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 15:08:27,978 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 15:08:27,983 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a721fc8fd40128f5701ac01735cfcb7, NAME => 'testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:08:27,983 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 08134699fb8fcf45891686455f45f6b7, NAME => 'testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:08:28,024 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:28,024 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:28,024 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 08134699fb8fcf45891686455f45f6b7, disabling compactions & flushes 2023-07-23 15:08:28,025 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8a721fc8fd40128f5701ac01735cfcb7, disabling compactions & flushes 2023-07-23 15:08:28,025 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,025 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,025 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:28,025 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:28,025 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. after waiting 0 ms 2023-07-23 15:08:28,025 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:28,025 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:28,025 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8a721fc8fd40128f5701ac01735cfcb7: 2023-07-23 15:08:28,026 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. after waiting 0 ms 2023-07-23 15:08:28,026 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,026 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,026 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 08134699fb8fcf45891686455f45f6b7: 2023-07-23 15:08:28,029 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:08:28,030 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124908030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124908030"}]},"ts":"1690124908030"} 2023-07-23 15:08:28,030 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124908030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124908030"}]},"ts":"1690124908030"} 2023-07-23 15:08:28,032 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:08:28,033 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:08:28,033 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124908033"}]},"ts":"1690124908033"} 2023-07-23 15:08:28,034 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 15:08:28,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 15:08:28,037 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:08:28,040 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:08:28,040 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:08:28,040 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:08:28,040 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:08:28,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=08134699fb8fcf45891686455f45f6b7, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a721fc8fd40128f5701ac01735cfcb7, ASSIGN}] 2023-07-23 15:08:28,043 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a721fc8fd40128f5701ac01735cfcb7, ASSIGN 2023-07-23 15:08:28,043 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=08134699fb8fcf45891686455f45f6b7, ASSIGN 2023-07-23 15:08:28,043 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=08134699fb8fcf45891686455f45f6b7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41023,1690124809736; forceNewPlan=false, retain=false 2023-07-23 15:08:28,043 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a721fc8fd40128f5701ac01735cfcb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38883,1690124809666; forceNewPlan=false, retain=false 2023-07-23 15:08:28,194 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:08:28,197 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=08134699fb8fcf45891686455f45f6b7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,197 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124908197"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124908197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124908197"}]},"ts":"1690124908197"} 2023-07-23 15:08:28,199 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8a721fc8fd40128f5701ac01735cfcb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,199 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124908199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124908199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124908199"}]},"ts":"1690124908199"} 2023-07-23 15:08:28,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 08134699fb8fcf45891686455f45f6b7, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:08:28,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 8a721fc8fd40128f5701ac01735cfcb7, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:08:28,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 15:08:28,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:28,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 08134699fb8fcf45891686455f45f6b7, NAME => 'testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:08:28,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a721fc8fd40128f5701ac01735cfcb7, NAME => 'testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. service=AccessControlService 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. service=AccessControlService 2023-07-23 15:08:28,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:28,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:28,359 INFO [StoreOpener-08134699fb8fcf45891686455f45f6b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:28,359 INFO [StoreOpener-8a721fc8fd40128f5701ac01735cfcb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:28,360 DEBUG [StoreOpener-08134699fb8fcf45891686455f45f6b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/cf 2023-07-23 15:08:28,360 DEBUG [StoreOpener-08134699fb8fcf45891686455f45f6b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/cf 2023-07-23 15:08:28,360 DEBUG [StoreOpener-8a721fc8fd40128f5701ac01735cfcb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/cf 2023-07-23 15:08:28,361 DEBUG [StoreOpener-8a721fc8fd40128f5701ac01735cfcb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/cf 2023-07-23 15:08:28,361 INFO [StoreOpener-08134699fb8fcf45891686455f45f6b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08134699fb8fcf45891686455f45f6b7 columnFamilyName cf 2023-07-23 15:08:28,361 INFO [StoreOpener-8a721fc8fd40128f5701ac01735cfcb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a721fc8fd40128f5701ac01735cfcb7 columnFamilyName cf 2023-07-23 15:08:28,362 INFO [StoreOpener-8a721fc8fd40128f5701ac01735cfcb7-1] regionserver.HStore(310): Store=8a721fc8fd40128f5701ac01735cfcb7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:28,362 INFO [StoreOpener-08134699fb8fcf45891686455f45f6b7-1] regionserver.HStore(310): Store=08134699fb8fcf45891686455f45f6b7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:28,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:28,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:28,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:28,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:28,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:28,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:28,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:28,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:28,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 08134699fb8fcf45891686455f45f6b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75456962, jitterRate=0.12439635396003723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:28,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 08134699fb8fcf45891686455f45f6b7: 2023-07-23 15:08:28,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a721fc8fd40128f5701ac01735cfcb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73638307, jitterRate=0.09729628264904022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:28,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a721fc8fd40128f5701ac01735cfcb7: 2023-07-23 15:08:28,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7., pid=94, masterSystemTime=1690124908353 2023-07-23 15:08:28,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7., pid=93, masterSystemTime=1690124908353 2023-07-23 15:08:28,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:28,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:28,381 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8a721fc8fd40128f5701ac01735cfcb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,381 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124908381"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124908381"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124908381"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124908381"}]},"ts":"1690124908381"} 2023-07-23 15:08:28,381 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=08134699fb8fcf45891686455f45f6b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,381 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124908381"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124908381"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124908381"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124908381"}]},"ts":"1690124908381"} 2023-07-23 15:08:28,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-23 15:08:28,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 8a721fc8fd40128f5701ac01735cfcb7, server=jenkins-hbase4.apache.org,38883,1690124809666 in 181 msec 2023-07-23 15:08:28,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-23 15:08:28,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 08134699fb8fcf45891686455f45f6b7, server=jenkins-hbase4.apache.org,41023,1690124809736 in 184 msec 2023-07-23 15:08:28,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a721fc8fd40128f5701ac01735cfcb7, ASSIGN in 344 msec 2023-07-23 15:08:28,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-23 15:08:28,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=08134699fb8fcf45891686455f45f6b7, ASSIGN in 345 msec 2023-07-23 15:08:28,390 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:08:28,390 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124908390"}]},"ts":"1690124908390"} 2023-07-23 15:08:28,391 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 15:08:28,393 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:08:28,394 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-23 15:08:28,396 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:08:28,397 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:28,397 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:28,397 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:28,398 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:28,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:28,400 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:28,400 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:28,400 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:28,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 469 msec 2023-07-23 15:08:28,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 15:08:28,541 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-23 15:08:28,544 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:28,544 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,546 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:28,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:28,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124908569 (current time:1690124908569). 2023-07-23 15:08:28,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:28,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x7d2334f2 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:28,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dba457d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:28,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:28,583 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:28,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d2334f2 to 127.0.0.1:63816 2023-07-23 15:08:28,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:28,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x558a0e1c to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:28,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31ea24fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:28,599 DEBUG [hconnection-0x3e740e16-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:28,603 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:28,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:28,610 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x558a0e1c to 127.0.0.1:63816 2023-07-23 15:08:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:08:28,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:28,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:28,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:28,619 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:28,620 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690125508620 2023-07-23 15:08:28,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:28,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:28,621 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:28,621 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:28,625 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:28,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:28,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-23 15:08:28,630 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:28,631 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690125508631 2023-07-23 15:08:28,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,647 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-23 15:08:28,647 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:28,651 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 15:08:28,651 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 15:08:28,651 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,651 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,656 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,656 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,656 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,656 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,657 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,657 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,658 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,658 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 15:08:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 15:08:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,659 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:28,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,661 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:28,661 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:28,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 15:08:28,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,664 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:28,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,676 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:28,676 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:28,676 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:28,677 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:28,676 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:28,677 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:28,677 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:28,678 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:28,678 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:28,678 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:28,678 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:28,687 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,689 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,690 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:28,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,691 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,691 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 15:08:28,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53f4d98[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:28,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 15:08:28,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53f4d98[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:28,704 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 15:08:28,704 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,705 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,705 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,705 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,706 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:28,706 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:28,706 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:28,706 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,706 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:08:28,706 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:28,706 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:28,706 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:28,706 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,706 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. started... 2023-07-23 15:08:28,706 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,706 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:28,706 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08134699fb8fcf45891686455f45f6b7: 2023-07-23 15:08:28,707 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,707 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:28,707 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:28,707 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:28,708 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:28,708 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:28,713 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:28,713 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:28,714 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:28,714 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. started... 2023-07-23 15:08:28,715 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a721fc8fd40128f5701ac01735cfcb7: 2023-07-23 15:08:28,716 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,716 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:28,716 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:28,721 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:28,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:28,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:28,723 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:28,803 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. completed. 2023-07-23 15:08:28,803 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:28,803 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:28,803 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:28,803 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,804 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. completed. 2023-07-23 15:08:28,804 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:28,804 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:28,804 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:08:28,804 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:28,804 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:28,804 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,804 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:28,804 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:08:28,805 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:28,805 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,805 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:28,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,806 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:28,807 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:28,807 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:28,807 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,807 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:28,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38883,1690124809666': 2023-07-23 15:08:28,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 15:08:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:08:28,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 15:08:28,818 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 15:08:28,818 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:28,818 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:28,818 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,818 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:28,821 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,821 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,821 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,821 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:28,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,821 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,822 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,821 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:28,822 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,823 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:28,823 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,825 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,825 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,826 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,829 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,829 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,829 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,829 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,830 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,830 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,830 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:28,830 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:28,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,830 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,830 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:28,832 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,832 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:28,833 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,833 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:28,833 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:28,833 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,833 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,830 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:28,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:28,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:08:28,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 15:08:28,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:28,923 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:28,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:28,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:28,925 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:08:29,225 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:29,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:29,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:29,227 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 15:08:29,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 15:08:29,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,300 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690124908621Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690124908848 (+227 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690124908848Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690124908848Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690124908851 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690124908863 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690124909299 (+436 ms) 2023-07-23 15:08:29,303 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:29,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 679 msec 2023-07-23 15:08:29,727 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:29,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:29,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:29,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41023] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:29,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38883] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:29,737 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:29,737 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:29,737 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:29,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:29,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124909755 (current time:1690124909755). 2023-07-23 15:08:29,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:29,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x3f9ea130 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:29,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21840c6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:29,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:29,770 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:29,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f9ea130 to 127.0.0.1:63816 2023-07-23 15:08:29,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:29,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x5c7bcedd to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:29,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16a67343, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:29,778 DEBUG [hconnection-0x17c0c2a8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:29,779 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:29,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:29,787 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:29,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c7bcedd to 127.0.0.1:63816 2023-07-23 15:08:29,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:29,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 15:08:29,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:29,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:29,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:29,797 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:29,799 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690125509799 2023-07-23 15:08:29,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 15:08:29,799 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:29,799 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:29,799 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:29,805 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 15:08:29,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:29,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-23 15:08:29,808 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:29,809 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690125509809 2023-07-23 15:08:29,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,859 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-23 15:08:29,859 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:29,860 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 15:08:29,860 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 15:08:29,895 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,895 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,896 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:29,896 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:29,896 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:29,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:29,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:29,896 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:29,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:29,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,898 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:29,898 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:29,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,899 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:29,899 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 15:08:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:29,900 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:29,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 15:08:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:29,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,901 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:29,901 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 15:08:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,901 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:29,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:29,920 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:29,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:29,901 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 15:08:29,920 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:29,920 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:29,920 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:29,920 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:29,931 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:29,931 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:29,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,932 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:29,932 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 15:08:29,932 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:29,938 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 15:08:29,938 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 15:08:29,938 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 15:08:29,938 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:29,938 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:29,940 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,940 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,940 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:29,940 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:29,940 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,940 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:29,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:29,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:29,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:29,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:29,940 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:29,943 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,943 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:29,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:29,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 15:08:29,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47806ee[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:29,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:29,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 15:08:29,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47806ee[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:29,948 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 15:08:29,948 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,957 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,957 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,957 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:29,957 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:29,957 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:08:29,957 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:29,958 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:29,958 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:29,958 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 15:08:29,958 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:29,958 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:29,958 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:29,958 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:29,958 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:29,959 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. started... 2023-07-23 15:08:29,959 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a721fc8fd40128f5701ac01735cfcb7 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-23 15:08:29,962 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:29,962 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:29,962 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:29,975 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:29,981 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:29,981 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:29,981 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. started... 2023-07-23 15:08:29,982 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 08134699fb8fcf45891686455f45f6b7 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-23 15:08:30,035 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230723f31ae9400fdc4df6b0c3e446683f941a to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723f31ae9400fdc4df6b0c3e446683f941a 2023-07-23 15:08:30,076 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072336c7808f27ed4f50a3e90dd69c2f7853 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072336c7808f27ed4f50a3e90dd69c2f7853 2023-07-23 15:08:30,100 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/.tmp/cf/f33b2774e9ef43c7b4442eebe573dadc 2023-07-23 15:08:30,104 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/.tmp/cf/9c601c902f2c4a4cab160c2c358d0709 2023-07-23 15:08:30,108 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/.tmp/cf/f33b2774e9ef43c7b4442eebe573dadc as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/cf/f33b2774e9ef43c7b4442eebe573dadc 2023-07-23 15:08:30,110 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/.tmp/cf/9c601c902f2c4a4cab160c2c358d0709 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/cf/9c601c902f2c4a4cab160c2c358d0709 2023-07-23 15:08:30,114 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/cf/f33b2774e9ef43c7b4442eebe573dadc, entries=44, sequenceid=6, filesize=12.6 K 2023-07-23 15:08:30,115 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 8a721fc8fd40128f5701ac01735cfcb7 in 156ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:30,115 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-23 15:08:30,116 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a721fc8fd40128f5701ac01735cfcb7: 2023-07-23 15:08:30,116 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,118 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:30,118 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/cf/f33b2774e9ef43c7b4442eebe573dadc] hfiles 2023-07-23 15:08:30,118 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/cf/f33b2774e9ef43c7b4442eebe573dadc for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,122 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:30,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:30,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:30,124 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 15:08:30,127 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/cf/9c601c902f2c4a4cab160c2c358d0709, entries=6, sequenceid=6, filesize=5.9 K 2023-07-23 15:08:30,129 INFO [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 08134699fb8fcf45891686455f45f6b7 in 147ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:30,132 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08134699fb8fcf45891686455f45f6b7: 2023-07-23 15:08:30,132 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,132 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:30,132 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/cf/9c601c902f2c4a4cab160c2c358d0709] hfiles 2023-07-23 15:08:30,133 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/cf/9c601c902f2c4a4cab160c2c358d0709 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,135 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. completed. 2023-07-23 15:08:30,136 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:08:30,138 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,138 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:30,138 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:30,138 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38883,1690124809666': 2023-07-23 15:08:30,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 15:08:30,161 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. completed. 2023-07-23 15:08:30,161 DEBUG [rs(jenkins-hbase4.apache.org,41023,1690124809736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:30,161 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:30,161 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:30,161 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,161 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 15:08:30,161 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:08:30,163 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 15:08:30,163 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,163 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:30,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:30,163 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 15:08:30,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:30,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:30,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:30,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41023,1690124809736': 2023-07-23 15:08:30,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 15:08:30,170 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 15:08:30,170 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:30,170 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:30,170 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,170 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:30,175 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,175 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,175 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:30,175 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,176 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:30,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,175 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,176 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:30,176 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:30,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:30,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,177 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:30,178 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:30,180 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,181 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,181 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,184 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,184 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,185 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,185 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:30,185 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,185 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:30,185 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:30,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:30,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,185 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:30,187 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:30,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:30,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:30,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:30,185 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:30,187 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:30,185 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:30,185 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,187 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:30,187 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,187 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:30,187 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:30,187 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,187 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:30,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:30,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:30,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:30,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:30,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:30,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:08:30,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:30,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:30,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723f31ae9400fdc4df6b0c3e446683f941a, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072336c7808f27ed4f50a3e90dd69c2f7853] mob files 2023-07-23 15:08:30,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723f31ae9400fdc4df6b0c3e446683f941a 2023-07-23 15:08:30,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072336c7808f27ed4f50a3e90dd69c2f7853 2023-07-23 15:08:30,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 15:08:30,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,380 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690124909799Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690124910235 (+436 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690124910235Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690124910235Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690124910251 (+16 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690124910293 (+42 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690124910379 (+86 ms) 2023-07-23 15:08:30,384 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 15:08:30,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 580 msec 2023-07-23 15:08:30,424 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:30,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 15:08:30,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:30,426 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426 2023-07-23 15:08:30,426 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44181, tgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426, rawTgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426, srcFsUri=hdfs://localhost:44181, srcDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:08:30,453 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:08:30,453 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1949428212_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,454 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661, snapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-23 15:08:30,469 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:30,508 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,508 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,508 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,509 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,509 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,509 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,510 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,589 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop-8340589939170318893.jar 2023-07-23 15:08:30,590 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,590 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,591 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,591 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,591 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,591 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:30,592 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:08:30,592 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:08:30,592 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:08:30,593 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:08:30,593 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:08:30,593 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:08:30,594 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:08:30,594 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:08:30,594 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:08:30,595 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:08:30,595 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:30,596 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:30,596 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:30,596 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:30,596 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:30,597 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:30,597 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:31,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0005_000001 (auth:SIMPLE) 2023-07-23 15:08:31,780 WARN [Listener at jenkins-hbase4.apache.org/42857] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:08:31,783 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-23 15:08:31,881 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:31,881 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:32,119 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0006_000001 (auth:SIMPLE) 2023-07-23 15:08:32,776 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:08:38,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0006_000001 (auth:SIMPLE) 2023-07-23 15:08:41,148 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:08:41,149 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:08:41,159 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:41,159 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:08:41,160 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:08:41,160 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:41,161 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 15:08:41,161 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 15:08:41,161 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:41,166 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 15:08:41,167 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124910426/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 15:08:41,176 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 15:08:41,187 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124921187"}]},"ts":"1690124921187"} 2023-07-23 15:08:41,189 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 15:08:41,191 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-23 15:08:41,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=08134699fb8fcf45891686455f45f6b7, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a721fc8fd40128f5701ac01735cfcb7, UNASSIGN}] 2023-07-23 15:08:41,198 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=08134699fb8fcf45891686455f45f6b7, UNASSIGN 2023-07-23 15:08:41,198 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a721fc8fd40128f5701ac01735cfcb7, UNASSIGN 2023-07-23 15:08:41,199 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8a721fc8fd40128f5701ac01735cfcb7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:41,199 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124921199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124921199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124921199"}]},"ts":"1690124921199"} 2023-07-23 15:08:41,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=08134699fb8fcf45891686455f45f6b7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:41,199 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124921199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124921199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124921199"}]},"ts":"1690124921199"} 2023-07-23 15:08:41,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 8a721fc8fd40128f5701ac01735cfcb7, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:08:41,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 08134699fb8fcf45891686455f45f6b7, server=jenkins-hbase4.apache.org,41023,1690124809736}] 2023-07-23 15:08:41,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 15:08:41,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:41,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a721fc8fd40128f5701ac01735cfcb7, disabling compactions & flushes 2023-07-23 15:08:41,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:41,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:41,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. after waiting 0 ms 2023-07-23 15:08:41,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:41,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:41,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 08134699fb8fcf45891686455f45f6b7, disabling compactions & flushes 2023-07-23 15:08:41,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:41,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:41,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. after waiting 0 ms 2023-07-23 15:08:41,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:41,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:41,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:41,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7. 2023-07-23 15:08:41,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 08134699fb8fcf45891686455f45f6b7: 2023-07-23 15:08:41,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:41,390 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=08134699fb8fcf45891686455f45f6b7, regionState=CLOSED 2023-07-23 15:08:41,390 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124921390"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124921390"}]},"ts":"1690124921390"} 2023-07-23 15:08:41,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:08:41,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:08:41,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7. 2023-07-23 15:08:41,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a721fc8fd40128f5701ac01735cfcb7: 2023-07-23 15:08:41,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:41,398 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-23 15:08:41,398 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 08134699fb8fcf45891686455f45f6b7, server=jenkins-hbase4.apache.org,41023,1690124809736 in 190 msec 2023-07-23 15:08:41,398 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8a721fc8fd40128f5701ac01735cfcb7, regionState=CLOSED 2023-07-23 15:08:41,399 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690124921398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124921398"}]},"ts":"1690124921398"} 2023-07-23 15:08:41,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=08134699fb8fcf45891686455f45f6b7, UNASSIGN in 206 msec 2023-07-23 15:08:41,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-23 15:08:41,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 8a721fc8fd40128f5701ac01735cfcb7, server=jenkins-hbase4.apache.org,38883,1690124809666 in 200 msec 2023-07-23 15:08:41,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-23 15:08:41,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a721fc8fd40128f5701ac01735cfcb7, UNASSIGN in 212 msec 2023-07-23 15:08:41,407 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124921407"}]},"ts":"1690124921407"} 2023-07-23 15:08:41,408 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 15:08:41,410 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-23 15:08:41,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 236 msec 2023-07-23 15:08:41,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 15:08:41,489 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-23 15:08:41,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,499 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,500 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,501 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,505 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,505 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,505 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,505 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 15:08:41,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 15:08:41,506 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:41,507 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:41,509 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/recovered.edits] 2023-07-23 15:08:41,509 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/recovered.edits] 2023-07-23 15:08:41,512 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,512 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,512 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:41,512 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,512 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:41,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 15:08:41,512 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:41,512 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:41,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 15:08:41,515 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/cf/f33b2774e9ef43c7b4442eebe573dadc to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/cf/f33b2774e9ef43c7b4442eebe573dadc 2023-07-23 15:08:41,518 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/cf/9c601c902f2c4a4cab160c2c358d0709 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/cf/9c601c902f2c4a4cab160c2c358d0709 2023-07-23 15:08:41,519 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7/recovered.edits/9.seqid 2023-07-23 15:08:41,520 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a721fc8fd40128f5701ac01735cfcb7 2023-07-23 15:08:41,525 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7/recovered.edits/9.seqid 2023-07-23 15:08:41,525 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testEmptyExportFileSystemState/08134699fb8fcf45891686455f45f6b7 2023-07-23 15:08:41,525 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 15:08:41,526 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-23 15:08:41,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-23 15:08:41,527 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 15:08:41,527 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-23 15:08:41,533 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723f31ae9400fdc4df6b0c3e446683f941a to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723f31ae9400fdc4df6b0c3e446683f941a 2023-07-23 15:08:41,534 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072336c7808f27ed4f50a3e90dd69c2f7853 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072336c7808f27ed4f50a3e90dd69c2f7853 2023-07-23 15:08:41,535 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-23 15:08:41,538 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,540 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-23 15:08:41,542 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-23 15:08:41,547 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,547 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-23 15:08:41,547 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124921547"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:41,547 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124921547"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:41,549 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:08:41,549 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 08134699fb8fcf45891686455f45f6b7, NAME => 'testtb-testEmptyExportFileSystemState,,1690124907930.08134699fb8fcf45891686455f45f6b7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8a721fc8fd40128f5701ac01735cfcb7, NAME => 'testtb-testEmptyExportFileSystemState,1,1690124907930.8a721fc8fd40128f5701ac01735cfcb7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:08:41,549 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-23 15:08:41,549 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124921549"}]},"ts":"9223372036854775807"} 2023-07-23 15:08:41,557 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-23 15:08:41,559 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 15:08:41,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 69 msec 2023-07-23 15:08:41,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 15:08:41,615 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-23 15:08:41,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-23 15:08:41,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:41,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-23 15:08:41,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-23 15:08:41,665 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759 (was 756) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1097402312_1 at /127.0.0.1:59876 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:40993 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:50338 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:44275 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1097402312_1 at /127.0.0.1:43414 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:45969 from appattempt_1690124817653_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4674 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:32974 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=442 (was 364) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 181), AvailableMemoryMB=5611 (was 5262) - AvailableMemoryMB LEAK? - 2023-07-23 15:08:41,666 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-23 15:08:41,693 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=759, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=442, ProcessCount=180, AvailableMemoryMB=5608 2023-07-23 15:08:41,693 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-23 15:08:41,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 15:08:41,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:41,700 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 15:08:41,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-23 15:08:41,701 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 15:08:41,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 15:08:41,704 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423 2023-07-23 15:08:41,704 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791 2023-07-23 15:08:41,705 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791 empty. 2023-07-23 15:08:41,705 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423 empty. 2023-07-23 15:08:41,706 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791 2023-07-23 15:08:41,706 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423 2023-07-23 15:08:41,706 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 15:08:41,738 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-23 15:08:41,740 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 088068532c70ac1c3992da38df3d6791, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:08:41,740 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => bf5e03937fa6cca966c4336749e76423, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp 2023-07-23 15:08:41,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:41,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing bf5e03937fa6cca966c4336749e76423, disabling compactions & flushes 2023-07-23 15:08:41,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:41,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:41,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. after waiting 0 ms 2023-07-23 15:08:41,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:41,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:41,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for bf5e03937fa6cca966c4336749e76423: 2023-07-23 15:08:41,790 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:41,790 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 088068532c70ac1c3992da38df3d6791, disabling compactions & flushes 2023-07-23 15:08:41,790 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:41,790 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:41,790 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. after waiting 0 ms 2023-07-23 15:08:41,790 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:41,790 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:41,790 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 088068532c70ac1c3992da38df3d6791: 2023-07-23 15:08:41,793 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 15:08:41,794 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124921794"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124921794"}]},"ts":"1690124921794"} 2023-07-23 15:08:41,794 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124921794"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124921794"}]},"ts":"1690124921794"} 2023-07-23 15:08:41,797 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 15:08:41,797 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 15:08:41,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124921797"}]},"ts":"1690124921797"} 2023-07-23 15:08:41,799 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-23 15:08:41,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 15:08:41,803 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 15:08:41,804 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 15:08:41,804 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 15:08:41,804 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 15:08:41,805 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 15:08:41,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bf5e03937fa6cca966c4336749e76423, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=088068532c70ac1c3992da38df3d6791, ASSIGN}] 2023-07-23 15:08:41,808 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=088068532c70ac1c3992da38df3d6791, ASSIGN 2023-07-23 15:08:41,809 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bf5e03937fa6cca966c4336749e76423, ASSIGN 2023-07-23 15:08:41,809 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=088068532c70ac1c3992da38df3d6791, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38883,1690124809666; forceNewPlan=false, retain=false 2023-07-23 15:08:41,809 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bf5e03937fa6cca966c4336749e76423, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1690124809802; forceNewPlan=false, retain=false 2023-07-23 15:08:41,959 INFO [jenkins-hbase4:37385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 15:08:41,963 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bf5e03937fa6cca966c4336749e76423, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:41,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=088068532c70ac1c3992da38df3d6791, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:41,963 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124921963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124921963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124921963"}]},"ts":"1690124921963"} 2023-07-23 15:08:41,963 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124921963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124921963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124921963"}]},"ts":"1690124921963"} 2023-07-23 15:08:41,965 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure bf5e03937fa6cca966c4336749e76423, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:08:41,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 088068532c70ac1c3992da38df3d6791, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:08:42,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 15:08:42,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:42,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bf5e03937fa6cca966c4336749e76423, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 15:08:42,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. service=AccessControlService 2023-07-23 15:08:42,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:42,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:42,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 088068532c70ac1c3992da38df3d6791, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 15:08:42,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp bf5e03937fa6cca966c4336749e76423 2023-07-23 15:08:42,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:42,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. service=AccessControlService 2023-07-23 15:08:42,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bf5e03937fa6cca966c4336749e76423 2023-07-23 15:08:42,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bf5e03937fa6cca966c4336749e76423 2023-07-23 15:08:42,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 15:08:42,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 088068532c70ac1c3992da38df3d6791 2023-07-23 15:08:42,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 15:08:42,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 088068532c70ac1c3992da38df3d6791 2023-07-23 15:08:42,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 088068532c70ac1c3992da38df3d6791 2023-07-23 15:08:42,130 INFO [StoreOpener-bf5e03937fa6cca966c4336749e76423-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bf5e03937fa6cca966c4336749e76423 2023-07-23 15:08:42,130 INFO [StoreOpener-088068532c70ac1c3992da38df3d6791-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 088068532c70ac1c3992da38df3d6791 2023-07-23 15:08:42,132 DEBUG [StoreOpener-088068532c70ac1c3992da38df3d6791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/cf 2023-07-23 15:08:42,132 DEBUG [StoreOpener-088068532c70ac1c3992da38df3d6791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/cf 2023-07-23 15:08:42,132 DEBUG [StoreOpener-bf5e03937fa6cca966c4336749e76423-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/cf 2023-07-23 15:08:42,132 DEBUG [StoreOpener-bf5e03937fa6cca966c4336749e76423-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/cf 2023-07-23 15:08:42,132 INFO [StoreOpener-088068532c70ac1c3992da38df3d6791-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 088068532c70ac1c3992da38df3d6791 columnFamilyName cf 2023-07-23 15:08:42,133 INFO [StoreOpener-bf5e03937fa6cca966c4336749e76423-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf5e03937fa6cca966c4336749e76423 columnFamilyName cf 2023-07-23 15:08:42,134 INFO [StoreOpener-bf5e03937fa6cca966c4336749e76423-1] regionserver.HStore(310): Store=bf5e03937fa6cca966c4336749e76423/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:42,134 INFO [StoreOpener-088068532c70ac1c3992da38df3d6791-1] regionserver.HStore(310): Store=088068532c70ac1c3992da38df3d6791/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 15:08:42,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791 2023-07-23 15:08:42,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423 2023-07-23 15:08:42,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791 2023-07-23 15:08:42,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423 2023-07-23 15:08:42,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bf5e03937fa6cca966c4336749e76423 2023-07-23 15:08:42,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 088068532c70ac1c3992da38df3d6791 2023-07-23 15:08:42,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:42,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 15:08:42,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 088068532c70ac1c3992da38df3d6791; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72440355, jitterRate=0.07944540679454803}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:42,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 088068532c70ac1c3992da38df3d6791: 2023-07-23 15:08:42,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791., pid=109, masterSystemTime=1690124922118 2023-07-23 15:08:42,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bf5e03937fa6cca966c4336749e76423; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62188505, jitterRate=-0.07331906259059906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 15:08:42,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bf5e03937fa6cca966c4336749e76423: 2023-07-23 15:08:42,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423., pid=108, masterSystemTime=1690124922117 2023-07-23 15:08:42,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:42,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:42,152 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=088068532c70ac1c3992da38df3d6791, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,153 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124922152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124922152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124922152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124922152"}]},"ts":"1690124922152"} 2023-07-23 15:08:42,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:42,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:42,153 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bf5e03937fa6cca966c4336749e76423, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124922153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690124922153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690124922153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690124922153"}]},"ts":"1690124922153"} 2023-07-23 15:08:42,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-23 15:08:42,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 088068532c70ac1c3992da38df3d6791, server=jenkins-hbase4.apache.org,38883,1690124809666 in 188 msec 2023-07-23 15:08:42,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-23 15:08:42,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure bf5e03937fa6cca966c4336749e76423, server=jenkins-hbase4.apache.org,42581,1690124809802 in 190 msec 2023-07-23 15:08:42,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=088068532c70ac1c3992da38df3d6791, ASSIGN in 351 msec 2023-07-23 15:08:42,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-23 15:08:42,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bf5e03937fa6cca966c4336749e76423, ASSIGN in 352 msec 2023-07-23 15:08:42,159 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 15:08:42,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124922159"}]},"ts":"1690124922159"} 2023-07-23 15:08:42,161 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-23 15:08:42,167 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 15:08:42,167 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-23 15:08:42,169 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 15:08:42,173 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:42,173 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:42,178 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:42,178 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:08:42,179 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,179 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:42,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 15:08:42,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 484 msec 2023-07-23 15:08:42,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 15:08:42,307 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-23 15:08:42,315 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,315 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:42,317 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:42,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:42,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124922333 (current time:1690124922333). 2023-07-23 15:08:42,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:42,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x2395a5d3 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:42,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@140e025, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:42,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:42,371 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:42,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2395a5d3 to 127.0.0.1:63816 2023-07-23 15:08:42,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:42,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x4ec1b744 to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:42,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40f43872, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:42,392 DEBUG [hconnection-0x4633a981-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:42,397 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:42,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:42,405 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:42,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ec1b744 to 127.0.0.1:63816 2023-07-23 15:08:42,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:42,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 15:08:42,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:42,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:42,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:42,410 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:42,412 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690125522412 2023-07-23 15:08:42,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:42,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,414 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:42,414 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:42,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:42,416 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:42,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-23 15:08:42,418 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:42,418 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690125522418 2023-07-23 15:08:42,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,437 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 15:08:42,437 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:42,438 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 15:08:42,438 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 15:08:42,439 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,439 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,441 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:42,441 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:42,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:42,441 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:42,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:42,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:42,442 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,443 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,443 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 15:08:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,443 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 15:08:42,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,444 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,444 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:42,444 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 15:08:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,444 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:42,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,450 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:42,450 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:42,450 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:42,450 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:42,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:42,454 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:42,454 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:42,455 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:42,455 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:42,455 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:42,458 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,458 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:42,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:42,459 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,459 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:42,460 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,460 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,460 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:42,460 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,460 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:42,461 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,461 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:42,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:42,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:42,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 15:08:42,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4703a461[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:42,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:42,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 15:08:42,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4703a461[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:42,468 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 15:08:42,468 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:42,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:08:42,471 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:42,472 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. started... 2023-07-23 15:08:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:42,478 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:42,478 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:42,484 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 088068532c70ac1c3992da38df3d6791: 2023-07-23 15:08:42,484 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:42,484 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. started... 2023-07-23 15:08:42,484 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,484 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:42,484 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:42,484 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bf5e03937fa6cca966c4336749e76423: 2023-07-23 15:08:42,485 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,485 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:42,485 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 15:08:42,487 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,487 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:42,514 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:42,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 15:08:42,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:42,516 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:42,530 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. completed. 2023-07-23 15:08:42,530 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:42,530 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:42,530 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:42,530 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,530 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:42,530 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:08:42,532 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:42,533 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,533 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:42,533 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,533 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. completed. 2023-07-23 15:08:42,533 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:42,534 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:42,534 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:42,534 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:42,534 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:42,534 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:08:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:42,536 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:42,536 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:42,536 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:42,537 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42581,1690124809802': 2023-07-23 15:08:42,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 15:08:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:42,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38883,1690124809666': 2023-07-23 15:08:42,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 15:08:42,547 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 15:08:42,547 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:42,547 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:42,547 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,547 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:42,550 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:42,550 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,550 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:42,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:42,551 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,552 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,554 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:42,554 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,554 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,558 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:42,558 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:42,558 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:42,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:42,558 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:42,559 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:42,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:42,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:42,559 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:42,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:42,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,559 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:42,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:42,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,561 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,561 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,561 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,561 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:42,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:42,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:08:42,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:42,561 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,562 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,562 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,562 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,562 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,562 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,562 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 15:08:42,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 15:08:42,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,711 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690124922413Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690124922623 (+210 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690124922623Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690124922623Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690124922634 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690124922660 (+26 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690124922711 (+51 ms) 2023-07-23 15:08:42,714 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:42,715 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 300 msec 2023-07-23 15:08:42,716 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:42,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 15:08:42,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:42,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:42,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 15:08:42,724 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,724 DEBUG [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:42,724 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 15:08:42,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:42,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690124922742 (current time:1690124922742). 2023-07-23 15:08:42,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 15:08:42,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x1f7f65cc to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:42,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44dba803, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:42,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:42,763 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:42,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f7f65cc to 127.0.0.1:63816 2023-07-23 15:08:42,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:42,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(139): Connect 0x40bc3ebb to 127.0.0.1:63816 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 15:08:42,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24897265, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 15:08:42,874 DEBUG [hconnection-0x3d8b4d47-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:42,879 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:42,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 15:08:42,886 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 15:08:42,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40bc3ebb to 127.0.0.1:63816 2023-07-23 15:08:42,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:08:42,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 15:08:42,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 15:08:42,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:42,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:42,892 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:42,892 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690125522892 2023-07-23 15:08:42,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 15:08:42,894 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 15:08:42,894 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 15:08:42,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:42,895 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 15:08:42,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-23 15:08:42,897 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:42,898 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690125522898 2023-07-23 15:08:42,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,922 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 15:08:42,923 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:42,924 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 15:08:42,924 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 15:08:42,925 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,925 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,926 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:42,926 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:42,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:42,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:42,926 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,926 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:42,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:42,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:42,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,927 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,927 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,927 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,927 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 15:08:42,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 15:08:42,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,928 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:42,928 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:42,928 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 15:08:42,930 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 15:08:42,930 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:42,930 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,930 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:42,930 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 15:08:42,934 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,934 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,934 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:42,936 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:42,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38883,1690124809666' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 15:08:42,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bd2463e[Count = 1] remaining members to acquire global barrier 2023-07-23 15:08:42,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,939 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:42,939 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 15:08:42,939 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:42,939 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 15:08:42,940 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:42,942 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:42,942 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 15:08:42,942 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 15:08:42,942 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41023,1690124809736' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:42,942 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 15:08:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,944 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,944 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:42,944 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,944 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:42,944 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,944 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 15:08:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:42,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1690124809802' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 15:08:42,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bd2463e[Count = 0] remaining members to acquire global barrier 2023-07-23 15:08:42,947 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 15:08:42,947 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,952 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,952 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,952 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,953 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:42,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 15:08:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41023,1690124809736' in zk 2023-07-23 15:08:42,953 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:42,953 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 15:08:42,953 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:42,953 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. started... 2023-07-23 15:08:42,953 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 15:08:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 15:08:42,953 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. started... 2023-07-23 15:08:42,953 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bf5e03937fa6cca966c4336749e76423 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 15:08:42,954 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 088068532c70ac1c3992da38df3d6791 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 15:08:42,956 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:42,956 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:42,956 DEBUG [member: 'jenkins-hbase4.apache.org,41023,1690124809736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:42,994 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:42,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 15:08:42,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 15:08:42,998 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 15:08:43,005 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230723e0266748cf0243e386b5fed4ba49ae5b to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230723e0266748cf0243e386b5fed4ba49ae5b 2023-07-23 15:08:43,006 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307233618e7f008814ea286ff3cff3841669a to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307233618e7f008814ea286ff3cff3841669a 2023-07-23 15:08:43,028 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/.tmp/cf/507e7021d56a4943ae57c823048ac4b9 2023-07-23 15:08:43,028 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/.tmp/cf/491dfe69eada442e8a85a467306922af 2023-07-23 15:08:43,034 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/.tmp/cf/491dfe69eada442e8a85a467306922af as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/cf/491dfe69eada442e8a85a467306922af 2023-07-23 15:08:43,035 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/.tmp/cf/507e7021d56a4943ae57c823048ac4b9 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/cf/507e7021d56a4943ae57c823048ac4b9 2023-07-23 15:08:43,038 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/cf/491dfe69eada442e8a85a467306922af, entries=46, sequenceid=6, filesize=13.2 K 2023-07-23 15:08:43,039 INFO [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 088068532c70ac1c3992da38df3d6791 in 85ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:43,039 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-23 15:08:43,040 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 088068532c70ac1c3992da38df3d6791: 2023-07-23 15:08:43,040 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,040 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:43,040 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/cf/491dfe69eada442e8a85a467306922af] hfiles 2023-07-23 15:08:43,040 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/cf/491dfe69eada442e8a85a467306922af for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,040 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/cf/507e7021d56a4943ae57c823048ac4b9, entries=4, sequenceid=6, filesize=5.6 K 2023-07-23 15:08:43,041 INFO [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for bf5e03937fa6cca966c4336749e76423 in 88ms, sequenceid=6, compaction requested=false 2023-07-23 15:08:43,042 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bf5e03937fa6cca966c4336749e76423: 2023-07-23 15:08:43,042 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,042 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 15:08:43,042 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/cf/507e7021d56a4943ae57c823048ac4b9] hfiles 2023-07-23 15:08:43,042 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/cf/507e7021d56a4943ae57c823048ac4b9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,053 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. completed. 2023-07-23 15:08:43,053 DEBUG [rs(jenkins-hbase4.apache.org,38883,1690124809666)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:08:43,053 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:43,053 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:43,053 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,053 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:43,053 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38883,1690124809666' in zk 2023-07-23 15:08:43,055 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,055 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:43,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:43,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:43,055 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:43,055 DEBUG [member: 'jenkins-hbase4.apache.org,38883,1690124809666' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:43,057 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. completed. 2023-07-23 15:08:43,057 DEBUG [rs(jenkins-hbase4.apache.org,42581,1690124809802)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:08:43,058 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 15:08:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:43,058 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 15:08:43,058 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,058 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 15:08:43,058 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42581,1690124809802' in zk 2023-07-23 15:08:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,059 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,059 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 15:08:43,060 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:43,060 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1690124809802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 15:08:43,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:43,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38883,1690124809666': 2023-07-23 15:08:43,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38883,1690124809666' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 15:08:43,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:43,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:43,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:43,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:43,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42581,1690124809802': 2023-07-23 15:08:43,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1690124809802' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 15:08:43,067 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 15:08:43,067 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 15:08:43,067 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 15:08:43,067 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,067 INFO [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 15:08:43,070 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,070 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 15:08:43,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 15:08:43,070 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,070 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,071 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 15:08:43,071 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:43,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,071 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 15:08:43,072 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,072 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,072 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,074 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 15:08:43,074 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,074 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:43,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:43,077 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:43,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,077 DEBUG [(jenkins-hbase4.apache.org,37385,1690124808099)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 15:08:43,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:43,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:43,082 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 15:08:43,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:43,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 15:08:43,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,083 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 15:08:43,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 15:08:43,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:43,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:43,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 15:08:43,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 15:08:43,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 15:08:43,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230723e0266748cf0243e386b5fed4ba49ae5b, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307233618e7f008814ea286ff3cff3841669a] mob files 2023-07-23 15:08:43,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230723e0266748cf0243e386b5fed4ba49ae5b 2023-07-23 15:08:43,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307233618e7f008814ea286ff3cff3841669a 2023-07-23 15:08:43,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 15:08:43,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,132 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690124922893Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690124923091 (+198 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690124923091Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690124923091Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690124923098 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690124923107 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690124923131 (+24 ms) 2023-07-23 15:08:43,135 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 15:08:43,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 241 msec 2023-07-23 15:08:43,198 DEBUG [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 15:08:43,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 15:08:43,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 15:08:43,200 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200 2023-07-23 15:08:43,200 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44181, tgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200, rawTgtDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200, srcFsUri=hdfs://localhost:44181, srcDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:08:43,231 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661 2023-07-23 15:08:43,231 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-523149581_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,231 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44181, inputRoot=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661, snapshotDir=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-23 15:08:43,271 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:08:43,324 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,325 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,325 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,326 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,326 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,327 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,327 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,424 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/hadoop-7441015434214760513.jar 2023-07-23 15:08:43,425 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,426 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,426 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,426 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,427 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,427 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 15:08:43,428 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 15:08:43,429 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 15:08:43,429 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 15:08:43,430 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 15:08:43,430 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 15:08:43,431 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 15:08:43,431 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 15:08:43,432 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 15:08:43,432 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 15:08:43,433 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 15:08:43,433 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:43,434 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:43,434 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:43,435 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:43,435 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 15:08:43,435 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:43,436 DEBUG [Listener at jenkins-hbase4.apache.org/42857] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 15:08:44,728 WARN [Listener at jenkins-hbase4.apache.org/42857] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 15:08:44,731 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-23 15:08:44,733 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-23 15:08:46,231 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:46,232 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 15:08:46,236 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0006_000001 (auth:SIMPLE) 2023-07-23 15:08:46,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0007_000001 (auth:SIMPLE) 2023-07-23 15:08:47,110 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:08:53,176 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0007_000001 (auth:SIMPLE) 2023-07-23 15:08:55,471 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0007_000001 (auth:SIMPLE) 2023-07-23 15:08:59,793 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690124817653_0007_000001 (auth:SIMPLE) 2023-07-23 15:09:00,992 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 15:09:00,992 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 15:09:01,008 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,008 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 15:09:01,008 INFO [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 15:09:01,009 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,009 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 15:09:01,009 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 15:09:01,009 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-985650724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,010 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 15:09:01,010 DEBUG [Listener at jenkins-hbase4.apache.org/42857] snapshot.TestExportSnapshot(367): hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/export-test/export-1690124923200/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 15:09:01,022 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 15:09:01,028 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124941027"}]},"ts":"1690124941027"} 2023-07-23 15:09:01,029 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-23 15:09:01,032 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-23 15:09:01,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bf5e03937fa6cca966c4336749e76423, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=088068532c70ac1c3992da38df3d6791, UNASSIGN}] 2023-07-23 15:09:01,035 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bf5e03937fa6cca966c4336749e76423, UNASSIGN 2023-07-23 15:09:01,035 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=088068532c70ac1c3992da38df3d6791, UNASSIGN 2023-07-23 15:09:01,036 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bf5e03937fa6cca966c4336749e76423, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:09:01,036 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=088068532c70ac1c3992da38df3d6791, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:09:01,036 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124941036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124941036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124941036"}]},"ts":"1690124941036"} 2023-07-23 15:09:01,036 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124941036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690124941036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690124941036"}]},"ts":"1690124941036"} 2023-07-23 15:09:01,040 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure bf5e03937fa6cca966c4336749e76423, server=jenkins-hbase4.apache.org,42581,1690124809802}] 2023-07-23 15:09:01,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 088068532c70ac1c3992da38df3d6791, server=jenkins-hbase4.apache.org,38883,1690124809666}] 2023-07-23 15:09:01,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 15:09:01,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bf5e03937fa6cca966c4336749e76423 2023-07-23 15:09:01,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bf5e03937fa6cca966c4336749e76423, disabling compactions & flushes 2023-07-23 15:09:01,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:09:01,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:09:01,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. after waiting 0 ms 2023-07-23 15:09:01,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:09:01,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 088068532c70ac1c3992da38df3d6791 2023-07-23 15:09:01,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 088068532c70ac1c3992da38df3d6791, disabling compactions & flushes 2023-07-23 15:09:01,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:09:01,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:09:01,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. after waiting 0 ms 2023-07-23 15:09:01,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:09:01,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:09:01,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:01,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423. 2023-07-23 15:09:01,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bf5e03937fa6cca966c4336749e76423: 2023-07-23 15:09:01,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:09:01,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:01,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791. 2023-07-23 15:09:01,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 088068532c70ac1c3992da38df3d6791: 2023-07-23 15:09:01,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bf5e03937fa6cca966c4336749e76423 2023-07-23 15:09:01,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bf5e03937fa6cca966c4336749e76423, regionState=CLOSED 2023-07-23 15:09:01,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 088068532c70ac1c3992da38df3d6791 2023-07-23 15:09:01,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124941206"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124941206"}]},"ts":"1690124941206"} 2023-07-23 15:09:01,206 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=088068532c70ac1c3992da38df3d6791, regionState=CLOSED 2023-07-23 15:09:01,207 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690124941206"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690124941206"}]},"ts":"1690124941206"} 2023-07-23 15:09:01,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-23 15:09:01,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-23 15:09:01,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure bf5e03937fa6cca966c4336749e76423, server=jenkins-hbase4.apache.org,42581,1690124809802 in 167 msec 2023-07-23 15:09:01,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 088068532c70ac1c3992da38df3d6791, server=jenkins-hbase4.apache.org,38883,1690124809666 in 167 msec 2023-07-23 15:09:01,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bf5e03937fa6cca966c4336749e76423, UNASSIGN in 178 msec 2023-07-23 15:09:01,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-23 15:09:01,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=088068532c70ac1c3992da38df3d6791, UNASSIGN in 177 msec 2023-07-23 15:09:01,212 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690124941212"}]},"ts":"1690124941212"} 2023-07-23 15:09:01,213 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-23 15:09:01,215 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-23 15:09:01,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 192 msec 2023-07-23 15:09:01,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 15:09:01,330 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-23 15:09:01,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,334 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,335 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,336 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41023] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,338 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,338 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,338 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,338 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 15:09:01,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 15:09:01,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 15:09:01,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 15:09:01,339 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423 2023-07-23 15:09:01,339 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791 2023-07-23 15:09:01,341 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,341 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,341 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,341 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,341 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:09:01,341 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:09:01,341 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:09:01,341 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 15:09:01,342 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/recovered.edits] 2023-07-23 15:09:01,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 15:09:01,342 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/cf, FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/recovered.edits] 2023-07-23 15:09:01,346 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/cf/507e7021d56a4943ae57c823048ac4b9 to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/cf/507e7021d56a4943ae57c823048ac4b9 2023-07-23 15:09:01,346 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/cf/491dfe69eada442e8a85a467306922af to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/cf/491dfe69eada442e8a85a467306922af 2023-07-23 15:09:01,350 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791/recovered.edits/9.seqid 2023-07-23 15:09:01,350 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/recovered.edits/9.seqid to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423/recovered.edits/9.seqid 2023-07-23 15:09:01,350 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/088068532c70ac1c3992da38df3d6791 2023-07-23 15:09:01,350 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bf5e03937fa6cca966c4336749e76423 2023-07-23 15:09:01,350 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 15:09:01,351 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-23 15:09:01,351 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-23 15:09:01,355 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230723e0266748cf0243e386b5fed4ba49ae5b to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230723e0266748cf0243e386b5fed4ba49ae5b 2023-07-23 15:09:01,356 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307233618e7f008814ea286ff3cff3841669a to hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307233618e7f008814ea286ff3cff3841669a 2023-07-23 15:09:01,357 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-23 15:09:01,359 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,361 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-23 15:09:01,363 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-23 15:09:01,364 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,364 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-23 15:09:01,364 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124941364"}]},"ts":"9223372036854775807"} 2023-07-23 15:09:01,364 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690124941364"}]},"ts":"9223372036854775807"} 2023-07-23 15:09:01,365 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 15:09:01,365 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bf5e03937fa6cca966c4336749e76423, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690124921695.bf5e03937fa6cca966c4336749e76423.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 088068532c70ac1c3992da38df3d6791, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690124921695.088068532c70ac1c3992da38df3d6791.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 15:09:01,365 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-23 15:09:01,365 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690124941365"}]},"ts":"9223372036854775807"} 2023-07-23 15:09:01,367 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-23 15:09:01,368 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-07-23 15:09:01,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 15:09:01,443 INFO [Listener at jenkins-hbase4.apache.org/42857] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-23 15:09:01,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 15:09:01,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 15:09:01,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 15:09:01,479 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-241304499_1 at /127.0.0.1:33496 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:55042 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-985650724_17 at /127.0.0.1:46316 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1740147250_17 at /127.0.0.1:38522 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1809822109) connection to jenkins-hbase4.apache.org/172.31.14.131:36173 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5e5ee97d-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-241304499_1 at /127.0.0.1:58564 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=544 (was 442) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 180), AvailableMemoryMB=5280 (was 5608) 2023-07-23 15:09:01,480 WARN [Listener at jenkins-hbase4.apache.org/42857] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-23 15:09:01,480 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-23 15:09:01,490 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 15:09:01,606 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690124817653_0007_01_000001 is : 143 2023-07-23 15:09:06,820 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 15:09:15,619 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 15:09:29,774 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 15:09:29,775 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 15:09:29,895 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-23 15:09:29,905 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-23 15:09:29,906 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 15:09:29,923 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 15:09:29,929 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 15:09:29,929 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-23 15:09:29,929 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-23 15:09:29,930 INFO [Listener at jenkins-hbase4.apache.org/42857] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-23 15:09:29,930 DEBUG [Listener at jenkins-hbase4.apache.org/42857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bd08a84 to 127.0.0.1:63816 2023-07-23 15:09:29,930 DEBUG [Listener at jenkins-hbase4.apache.org/42857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:29,932 DEBUG [Listener at jenkins-hbase4.apache.org/42857] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-23 15:09:29,932 DEBUG [Listener at jenkins-hbase4.apache.org/42857] util.JVMClusterUtil(257): Found active master hash=955693229, stopped=false 2023-07-23 15:09:29,932 DEBUG [Listener at jenkins-hbase4.apache.org/42857] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:29,933 DEBUG [Listener at jenkins-hbase4.apache.org/42857] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 15:09:29,933 INFO [Listener at jenkins-hbase4.apache.org/42857] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:09:29,935 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 15:09:29,935 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 15:09:29,935 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 15:09:29,935 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 15:09:29,935 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:09:29,935 INFO [Listener at jenkins-hbase4.apache.org/42857] procedure2.ProcedureExecutor(629): Stopping 2023-07-23 15:09:29,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:09:29,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:09:29,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:09:29,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 15:09:29,936 DEBUG [Listener at jenkins-hbase4.apache.org/42857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23cfa61b to 127.0.0.1:63816 2023-07-23 15:09:29,936 DEBUG [Listener at jenkins-hbase4.apache.org/42857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:29,936 INFO [Listener at jenkins-hbase4.apache.org/42857] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38883,1690124809666' ***** 2023-07-23 15:09:29,936 DEBUG [Listener at jenkins-hbase4.apache.org/42857] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:29,936 INFO [Listener at jenkins-hbase4.apache.org/42857] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 15:09:29,937 INFO [Listener at jenkins-hbase4.apache.org/42857] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41023,1690124809736' ***** 2023-07-23 15:09:29,937 DEBUG [Listener at jenkins-hbase4.apache.org/42857] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:29,937 INFO [Listener at jenkins-hbase4.apache.org/42857] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 15:09:29,937 INFO [RS:0;jenkins-hbase4:38883] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 15:09:29,937 INFO [Listener at jenkins-hbase4.apache.org/42857] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42581,1690124809802' ***** 2023-07-23 15:09:29,937 INFO [RS:1;jenkins-hbase4:41023] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 15:09:29,937 INFO [RS:0;jenkins-hbase4:38883] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 15:09:29,937 INFO [RS:1;jenkins-hbase4:41023] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 15:09:29,937 INFO [RS:0;jenkins-hbase4:38883] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 15:09:29,937 INFO [RS:1;jenkins-hbase4:41023] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 15:09:29,937 DEBUG [Listener at jenkins-hbase4.apache.org/42857] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:29,937 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 15:09:29,937 INFO [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:09:29,937 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 15:09:29,937 DEBUG [RS:0;jenkins-hbase4:38883] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x502d5efb to 127.0.0.1:63816 2023-07-23 15:09:29,937 DEBUG [RS:0;jenkins-hbase4:38883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:29,937 INFO [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(3305): Received CLOSE for abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:09:29,937 INFO [Listener at jenkins-hbase4.apache.org/42857] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 15:09:29,938 INFO [RS:2;jenkins-hbase4:42581] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 15:09:29,938 INFO [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:09:29,938 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 15:09:29,938 DEBUG [RS:1;jenkins-hbase4:41023] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45129a40 to 127.0.0.1:63816 2023-07-23 15:09:29,938 INFO [RS:2;jenkins-hbase4:42581] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 15:09:29,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing abe59583370c1eb91b86f9bbce69f6cd, disabling compactions & flushes 2023-07-23 15:09:29,940 INFO [RS:0;jenkins-hbase4:38883] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 15:09:29,940 INFO [RS:0;jenkins-hbase4:38883] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 15:09:29,940 INFO [RS:0;jenkins-hbase4:38883] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 15:09:29,940 INFO [RS:2;jenkins-hbase4:42581] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 15:09:29,940 INFO [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-23 15:09:29,938 DEBUG [RS:1;jenkins-hbase4:41023] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:29,940 INFO [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(3305): Received CLOSE for 5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:09:29,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:09:29,941 INFO [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:09:29,941 INFO [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 15:09:29,941 DEBUG [RS:2;jenkins-hbase4:42581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x036d33ea to 127.0.0.1:63816 2023-07-23 15:09:29,941 DEBUG [RS:2;jenkins-hbase4:42581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:29,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:09:29,941 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1478): Online Regions={abe59583370c1eb91b86f9bbce69f6cd=hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd.} 2023-07-23 15:09:29,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. after waiting 0 ms 2023-07-23 15:09:29,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:09:29,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing abe59583370c1eb91b86f9bbce69f6cd 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-23 15:09:29,942 INFO [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 15:09:29,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5bfd8885fc18777b8a92ffb83a412022, disabling compactions & flushes 2023-07-23 15:09:29,942 INFO [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 15:09:29,942 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1478): Online Regions={5bfd8885fc18777b8a92ffb83a412022=hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022.} 2023-07-23 15:09:29,942 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1504): Waiting on abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:09:29,943 DEBUG [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1504): Waiting on 5bfd8885fc18777b8a92ffb83a412022 2023-07-23 15:09:29,942 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-23 15:09:29,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:09:29,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 15:09:29,943 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-23 15:09:29,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:09:29,943 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 15:09:29,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. after waiting 0 ms 2023-07-23 15:09:29,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:09:29,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 15:09:29,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5bfd8885fc18777b8a92ffb83a412022 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-23 15:09:29,944 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 15:09:29,944 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 15:09:29,944 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-23 15:09:29,979 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:29,979 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:29,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022/.tmp/info/41b4022d2a2e49b8be961f8df4993610 2023-07-23 15:09:30,004 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:30,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022/.tmp/info/41b4022d2a2e49b8be961f8df4993610 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022/info/41b4022d2a2e49b8be961f8df4993610 2023-07-23 15:09:30,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/.tmp/info/27e1f941d3fb4016b1c2b3c96b765769 2023-07-23 15:09:30,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022/info/41b4022d2a2e49b8be961f8df4993610, entries=2, sequenceid=6, filesize=4.8 K 2023-07-23 15:09:30,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27e1f941d3fb4016b1c2b3c96b765769 2023-07-23 15:09:30,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5bfd8885fc18777b8a92ffb83a412022 in 85ms, sequenceid=6, compaction requested=false 2023-07-23 15:09:30,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/namespace/5bfd8885fc18777b8a92ffb83a412022/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 15:09:30,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:30,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:09:30,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5bfd8885fc18777b8a92ffb83a412022: 2023-07-23 15:09:30,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690124812552.5bfd8885fc18777b8a92ffb83a412022. 2023-07-23 15:09:30,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/.tmp/rep_barrier/aa89a219339a4a2b925834543324cf52 2023-07-23 15:09:30,071 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa89a219339a4a2b925834543324cf52 2023-07-23 15:09:30,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/.tmp/table/2ff4eccd54d64e33af3f1fa26e32788e 2023-07-23 15:09:30,129 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ff4eccd54d64e33af3f1fa26e32788e 2023-07-23 15:09:30,131 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/.tmp/info/27e1f941d3fb4016b1c2b3c96b765769 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/info/27e1f941d3fb4016b1c2b3c96b765769 2023-07-23 15:09:30,143 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1504): Waiting on abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:09:30,143 INFO [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42581,1690124809802; all regions closed. 2023-07-23 15:09:30,143 DEBUG [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-23 15:09:30,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27e1f941d3fb4016b1c2b3c96b765769 2023-07-23 15:09:30,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/info/27e1f941d3fb4016b1c2b3c96b765769, entries=48, sequenceid=131, filesize=10.3 K 2023-07-23 15:09:30,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/.tmp/rep_barrier/aa89a219339a4a2b925834543324cf52 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/rep_barrier/aa89a219339a4a2b925834543324cf52 2023-07-23 15:09:30,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa89a219339a4a2b925834543324cf52 2023-07-23 15:09:30,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/rep_barrier/aa89a219339a4a2b925834543324cf52, entries=13, sequenceid=131, filesize=6.4 K 2023-07-23 15:09:30,161 DEBUG [RS:2;jenkins-hbase4:42581] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/oldWALs 2023-07-23 15:09:30,162 INFO [RS:2;jenkins-hbase4:42581] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42581%2C1690124809802:(num 1690124811978) 2023-07-23 15:09:30,162 DEBUG [RS:2;jenkins-hbase4:42581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:30,162 INFO [RS:2;jenkins-hbase4:42581] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:30,162 INFO [RS:2;jenkins-hbase4:42581] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-23 15:09:30,162 INFO [RS:2;jenkins-hbase4:42581] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 15:09:30,162 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 15:09:30,162 INFO [RS:2;jenkins-hbase4:42581] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 15:09:30,163 INFO [RS:2;jenkins-hbase4:42581] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 15:09:30,165 INFO [RS:2;jenkins-hbase4:42581] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42581 2023-07-23 15:09:30,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/.tmp/table/2ff4eccd54d64e33af3f1fa26e32788e as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/table/2ff4eccd54d64e33af3f1fa26e32788e 2023-07-23 15:09:30,176 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:09:30,176 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:30,176 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:09:30,176 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42581,1690124809802 2023-07-23 15:09:30,176 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:30,176 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:30,176 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:30,178 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ff4eccd54d64e33af3f1fa26e32788e 2023-07-23 15:09:30,178 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/table/2ff4eccd54d64e33af3f1fa26e32788e, entries=24, sequenceid=131, filesize=6.9 K 2023-07-23 15:09:30,179 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42581,1690124809802] 2023-07-23 15:09:30,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 235ms, sequenceid=131, compaction requested=false 2023-07-23 15:09:30,187 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42581,1690124809802; numProcessing=1 2023-07-23 15:09:30,192 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42581,1690124809802 already deleted, retry=false 2023-07-23 15:09:30,192 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42581,1690124809802 expired; onlineServers=2 2023-07-23 15:09:30,215 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-23 15:09:30,216 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:30,216 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 15:09:30,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 15:09:30,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 15:09:30,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-23 15:09:30,289 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:30,289 INFO [RS:2;jenkins-hbase4:42581] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42581,1690124809802; zookeeper connection closed. 2023-07-23 15:09:30,289 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x10192b86f000003, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:30,290 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@61c4cb00] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@61c4cb00 2023-07-23 15:09:30,343 DEBUG [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1504): Waiting on abe59583370c1eb91b86f9bbce69f6cd 2023-07-23 15:09:30,344 INFO [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38883,1690124809666; all regions closed. 2023-07-23 15:09:30,371 DEBUG [RS:0;jenkins-hbase4:38883] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/oldWALs 2023-07-23 15:09:30,371 INFO [RS:0;jenkins-hbase4:38883] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38883%2C1690124809666.meta:.meta(num 1690124812205) 2023-07-23 15:09:30,386 DEBUG [RS:0;jenkins-hbase4:38883] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/oldWALs 2023-07-23 15:09:30,386 INFO [RS:0;jenkins-hbase4:38883] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38883%2C1690124809666:(num 1690124811978) 2023-07-23 15:09:30,386 DEBUG [RS:0;jenkins-hbase4:38883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:30,386 INFO [RS:0;jenkins-hbase4:38883] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:30,387 INFO [RS:0;jenkins-hbase4:38883] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-23 15:09:30,387 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 15:09:30,389 INFO [RS:0;jenkins-hbase4:38883] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38883 2023-07-23 15:09:30,391 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:30,391 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:09:30,397 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38883,1690124809666 2023-07-23 15:09:30,398 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38883,1690124809666] 2023-07-23 15:09:30,398 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38883,1690124809666; numProcessing=2 2023-07-23 15:09:30,399 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38883,1690124809666 already deleted, retry=false 2023-07-23 15:09:30,399 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38883,1690124809666 expired; onlineServers=1 2023-07-23 15:09:30,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd/.tmp/l/22fb5b8f1f9d4c7cb0088bd1277f63b8 2023-07-23 15:09:30,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22fb5b8f1f9d4c7cb0088bd1277f63b8 2023-07-23 15:09:30,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd/.tmp/l/22fb5b8f1f9d4c7cb0088bd1277f63b8 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd/l/22fb5b8f1f9d4c7cb0088bd1277f63b8 2023-07-23 15:09:30,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22fb5b8f1f9d4c7cb0088bd1277f63b8 2023-07-23 15:09:30,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd/l/22fb5b8f1f9d4c7cb0088bd1277f63b8, entries=7, sequenceid=18, filesize=5.2 K 2023-07-23 15:09:30,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for abe59583370c1eb91b86f9bbce69f6cd in 481ms, sequenceid=18, compaction requested=false 2023-07-23 15:09:30,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/data/hbase/acl/abe59583370c1eb91b86f9bbce69f6cd/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-23 15:09:30,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 15:09:30,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:09:30,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for abe59583370c1eb91b86f9bbce69f6cd: 2023-07-23 15:09:30,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690124813297.abe59583370c1eb91b86f9bbce69f6cd. 2023-07-23 15:09:30,499 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:30,499 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:38883-0x10192b86f000001, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:30,500 INFO [RS:0;jenkins-hbase4:38883] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38883,1690124809666; zookeeper connection closed. 2023-07-23 15:09:30,503 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@52bee860] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@52bee860 2023-07-23 15:09:30,543 INFO [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41023,1690124809736; all regions closed. 2023-07-23 15:09:30,587 DEBUG [RS:1;jenkins-hbase4:41023] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/oldWALs 2023-07-23 15:09:30,588 INFO [RS:1;jenkins-hbase4:41023] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41023%2C1690124809736:(num 1690124811978) 2023-07-23 15:09:30,588 DEBUG [RS:1;jenkins-hbase4:41023] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:30,588 INFO [RS:1;jenkins-hbase4:41023] regionserver.LeaseManager(133): Closed leases 2023-07-23 15:09:30,588 INFO [RS:1;jenkins-hbase4:41023] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-23 15:09:30,588 INFO [RS:1;jenkins-hbase4:41023] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 15:09:30,588 INFO [RS:1;jenkins-hbase4:41023] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 15:09:30,588 INFO [RS:1;jenkins-hbase4:41023] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 15:09:30,589 INFO [RS:1;jenkins-hbase4:41023] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41023 2023-07-23 15:09:30,591 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 15:09:30,592 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41023,1690124809736 2023-07-23 15:09:30,592 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 15:09:30,594 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41023,1690124809736] 2023-07-23 15:09:30,594 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41023,1690124809736; numProcessing=3 2023-07-23 15:09:30,694 INFO [RS:1;jenkins-hbase4:41023] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41023,1690124809736; zookeeper connection closed. 2023-07-23 15:09:30,695 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:30,695 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): regionserver:41023-0x10192b86f000002, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:30,696 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41023,1690124809736 already deleted, retry=false 2023-07-23 15:09:30,696 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41023,1690124809736 expired; onlineServers=0 2023-07-23 15:09:30,696 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37385,1690124808099' ***** 2023-07-23 15:09:30,696 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-23 15:09:30,696 DEBUG [M:0;jenkins-hbase4:37385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79cbb296, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 15:09:30,696 INFO [M:0;jenkins-hbase4:37385] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37385,1690124808099 2023-07-23 15:09:30,696 INFO [M:0;jenkins-hbase4:37385] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37385,1690124808099; all regions closed. 2023-07-23 15:09:30,696 DEBUG [M:0;jenkins-hbase4:37385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 15:09:30,697 DEBUG [M:0;jenkins-hbase4:37385] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-23 15:09:30,699 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-23 15:09:30,699 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 15:09:30,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 15:09:30,703 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-23 15:09:30,703 DEBUG [M:0;jenkins-hbase4:37385] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-23 15:09:30,703 INFO [M:0;jenkins-hbase4:37385] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-23 15:09:30,703 INFO [M:0;jenkins-hbase4:37385] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-23 15:09:30,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690124811455] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690124811455,5,FailOnTimeoutGroup] 2023-07-23 15:09:30,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690124811447] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690124811447,5,FailOnTimeoutGroup] 2023-07-23 15:09:30,704 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3cee711c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3cee711c 2023-07-23 15:09:30,704 INFO [Listener at jenkins-hbase4.apache.org/42857] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-23 15:09:30,704 INFO [M:0;jenkins-hbase4:37385] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-23 15:09:30,704 DEBUG [M:0;jenkins-hbase4:37385] master.HMaster(1512): Stopping service threads 2023-07-23 15:09:30,704 INFO [M:0;jenkins-hbase4:37385] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-23 15:09:30,705 ERROR [M:0;jenkins-hbase4:37385] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-23 15:09:30,706 INFO [M:0;jenkins-hbase4:37385] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-23 15:09:30,706 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-23 15:09:30,706 DEBUG [M:0;jenkins-hbase4:37385] zookeeper.ZKUtil(398): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-23 15:09:30,707 WARN [M:0;jenkins-hbase4:37385] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-23 15:09:30,707 INFO [M:0;jenkins-hbase4:37385] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-23 15:09:30,707 INFO [M:0;jenkins-hbase4:37385] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-23 15:09:30,708 DEBUG [M:0;jenkins-hbase4:37385] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 15:09:30,708 INFO [M:0;jenkins-hbase4:37385] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:09:30,708 DEBUG [M:0;jenkins-hbase4:37385] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:09:30,708 DEBUG [M:0;jenkins-hbase4:37385] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 15:09:30,708 DEBUG [M:0;jenkins-hbase4:37385] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:09:30,708 INFO [M:0;jenkins-hbase4:37385] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.92 KB heapSize=452.15 KB 2023-07-23 15:09:30,791 INFO [M:0;jenkins-hbase4:37385] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.92 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/af4468079ac24587bb4407eb90dec327 2023-07-23 15:09:30,797 INFO [M:0;jenkins-hbase4:37385] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af4468079ac24587bb4407eb90dec327 2023-07-23 15:09:30,798 DEBUG [M:0;jenkins-hbase4:37385] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/af4468079ac24587bb4407eb90dec327 as hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/af4468079ac24587bb4407eb90dec327 2023-07-23 15:09:30,803 INFO [M:0;jenkins-hbase4:37385] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af4468079ac24587bb4407eb90dec327 2023-07-23 15:09:30,804 INFO [M:0;jenkins-hbase4:37385] regionserver.HStore(1080): Added hdfs://localhost:44181/user/jenkins/test-data/48211213-2707-263c-fcca-c346b5de7661/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/af4468079ac24587bb4407eb90dec327, entries=119, sequenceid=899, filesize=28.7 K 2023-07-23 15:09:30,805 INFO [M:0;jenkins-hbase4:37385] regionserver.HRegion(2948): Finished flush of dataSize ~375.92 KB/384944, heapSize ~452.13 KB/462984, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 97ms, sequenceid=899, compaction requested=false 2023-07-23 15:09:30,841 INFO [M:0;jenkins-hbase4:37385] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 15:09:30,841 DEBUG [M:0;jenkins-hbase4:37385] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 15:09:30,871 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 15:09:30,872 INFO [M:0;jenkins-hbase4:37385] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-23 15:09:30,873 INFO [M:0;jenkins-hbase4:37385] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37385 2023-07-23 15:09:30,877 DEBUG [M:0;jenkins-hbase4:37385] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37385,1690124808099 already deleted, retry=false 2023-07-23 15:09:30,979 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:30,979 INFO [M:0;jenkins-hbase4:37385] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37385,1690124808099; zookeeper connection closed. 2023-07-23 15:09:30,979 DEBUG [Listener at localhost/45147-EventThread] zookeeper.ZKWatcher(600): master:37385-0x10192b86f000000, quorum=127.0.0.1:63816, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 15:09:30,981 WARN [Listener at jenkins-hbase4.apache.org/42857] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 15:09:31,013 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 15:09:31,019 WARN [BP-1179510516-172.31.14.131-1690124803866 heartbeating to localhost/127.0.0.1:44181] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 15:09:31,020 WARN [BP-1179510516-172.31.14.131-1690124803866 heartbeating to localhost/127.0.0.1:44181] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1179510516-172.31.14.131-1690124803866 (Datanode Uuid 8aafb742-18ec-4c12-8037-f64393a49c39) service to localhost/127.0.0.1:44181 2023-07-23 15:09:31,023 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data5/current/BP-1179510516-172.31.14.131-1690124803866] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:31,023 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data6/current/BP-1179510516-172.31.14.131-1690124803866] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:31,025 WARN [Listener at jenkins-hbase4.apache.org/42857] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 15:09:31,078 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 15:09:31,185 WARN [BP-1179510516-172.31.14.131-1690124803866 heartbeating to localhost/127.0.0.1:44181] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 15:09:31,185 WARN [BP-1179510516-172.31.14.131-1690124803866 heartbeating to localhost/127.0.0.1:44181] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1179510516-172.31.14.131-1690124803866 (Datanode Uuid daba712e-ac04-4416-9e69-583b1482ee4b) service to localhost/127.0.0.1:44181 2023-07-23 15:09:31,186 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data3/current/BP-1179510516-172.31.14.131-1690124803866] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:31,187 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data4/current/BP-1179510516-172.31.14.131-1690124803866] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:31,188 WARN [Listener at jenkins-hbase4.apache.org/42857] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 15:09:31,209 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 15:09:31,215 WARN [BP-1179510516-172.31.14.131-1690124803866 heartbeating to localhost/127.0.0.1:44181] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 15:09:31,215 WARN [BP-1179510516-172.31.14.131-1690124803866 heartbeating to localhost/127.0.0.1:44181] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1179510516-172.31.14.131-1690124803866 (Datanode Uuid 83321bb4-015f-4e97-b728-f7d7c591adae) service to localhost/127.0.0.1:44181 2023-07-23 15:09:31,216 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data1/current/BP-1179510516-172.31.14.131-1690124803866] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:31,217 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61b48d83-6862-3e1b-7f22-ab9b48ac40f6/cluster_17bb293a-4d7f-5029-957b-9ce1c2814e57/dfs/data/data2/current/BP-1179510516-172.31.14.131-1690124803866] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 15:09:31,283 INFO [Listener at jenkins-hbase4.apache.org/42857] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 15:09:31,324 INFO [Listener at jenkins-hbase4.apache.org/42857] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-23 15:09:31,471 INFO [Listener at jenkins-hbase4.apache.org/42857] hbase.HBaseTestingUtility(1293): Minicluster is down